Max level shown:
12025-01-16T23:30:02.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 01600a77-e7d0-4d35-86e6-c4c2a596ba16 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
22025-01-16T23:30:02.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 01600a77-e7d0-4d35-86e6-c4c2a596ba16 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
32025-01-16T23:30:02.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 01600a77-e7d0-4d35-86e6-c4c2a596ba16 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
42025-01-16T23:30:03.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 165f8865-8915-4e49-b418-5dd6b192566c roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
52025-01-16T23:30:03.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 165f8865-8915-4e49-b418-5dd6b192566c resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
62025-01-16T23:30:03.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 165f8865-8915-4e49-b418-5dd6b192566c response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72025-01-16T23:30:04.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1b6a403a-7331-4314-8c86-f5d2c9842736 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
82025-01-16T23:30:04.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1b6a403a-7331-4314-8c86-f5d2c9842736 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
92025-01-16T23:30:04.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1b6a403a-7331-4314-8c86-f5d2c9842736 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
102025-01-16T23:30:05.730ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 579 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = d260b8eb-941a-4814-ba3b-38160abde0dc response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
112025-01-16T23:30:05.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4532ac93-8e7b-498e-a3b3-02a07ff7aeca roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
122025-01-16T23:30:05.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4532ac93-8e7b-498e-a3b3-02a07ff7aeca resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
132025-01-16T23:30:05.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4532ac93-8e7b-498e-a3b3-02a07ff7aeca response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
142025-01-16T23:30:06.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a13e57a1-fc45-467a-91c4-fdd7a26779c0 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
152025-01-16T23:30:06.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a13e57a1-fc45-467a-91c4-fdd7a26779c0 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
162025-01-16T23:30:06.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a13e57a1-fc45-467a-91c4-fdd7a26779c0 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
172025-01-16T23:30:06.998ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
182025-01-16T23:30:06.998ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
192025-01-16T23:30:06.998ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
202025-01-16T23:30:06.998ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
212025-01-16T23:30:06.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
222025-01-16T23:30:06.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
232025-01-16T23:30:07.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
242025-01-16T23:30:07.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
252025-01-16T23:30:07.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
262025-01-16T23:30:07.002ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.349454ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
272025-01-16T23:30:07.002ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
282025-01-16T23:30:07.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
292025-01-16T23:30:07.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
302025-01-16T23:30:07.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
312025-01-16T23:30:07.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
322025-01-16T23:30:07.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
332025-01-16T23:30:07.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
342025-01-16T23:30:07.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
352025-01-16T23:30:07.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
362025-01-16T23:30:07.018ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
372025-01-16T23:30:07.018ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.597537ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
382025-01-16T23:30:08.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4006d85e-7555-41f6-810e-7afa823ef58f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
392025-01-16T23:30:08.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4006d85e-7555-41f6-810e-7afa823ef58f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
402025-01-16T23:30:08.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4006d85e-7555-41f6-810e-7afa823ef58f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
412025-01-16T23:30:09.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 83989931-f722-4718-b7c0-e82217aed304 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
422025-01-16T23:30:09.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 83989931-f722-4718-b7c0-e82217aed304 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
432025-01-16T23:30:09.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 83989931-f722-4718-b7c0-e82217aed304 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
442025-01-16T23:30:10.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 66f36441-c5c2-4245-81c4-479d17be4c2a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
452025-01-16T23:30:10.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 66f36441-c5c2-4245-81c4-479d17be4c2a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
462025-01-16T23:30:10.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 66f36441-c5c2-4245-81c4-479d17be4c2a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
472025-01-16T23:30:11.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bd7bcf84-bf74-4544-9b2c-22fc6596aaf1 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
482025-01-16T23:30:11.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bd7bcf84-bf74-4544-9b2c-22fc6596aaf1 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
492025-01-16T23:30:11.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bd7bcf84-bf74-4544-9b2c-22fc6596aaf1 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
502025-01-16T23:30:12.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 417d91e5-9b4c-4c1a-b90a-0a73c3716fff roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
512025-01-16T23:30:12.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 417d91e5-9b4c-4c1a-b90a-0a73c3716fff resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
522025-01-16T23:30:12.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 417d91e5-9b4c-4c1a-b90a-0a73c3716fff response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
532025-01-16T23:30:13.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7880a32f-5bd4-4646-9281-3067ea2a38d8 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
542025-01-16T23:30:13.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7880a32f-5bd4-4646-9281-3067ea2a38d8 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
552025-01-16T23:30:13.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7880a32f-5bd4-4646-9281-3067ea2a38d8 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
562025-01-16T23:30:14.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a4c2a1ca-d996-4ccd-86d4-8882833d5ce8 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
572025-01-16T23:30:14.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a4c2a1ca-d996-4ccd-86d4-8882833d5ce8 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
582025-01-16T23:30:14.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a4c2a1ca-d996-4ccd-86d4-8882833d5ce8 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
592025-01-16T23:30:15.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d7e8588e-1269-4e63-938e-c9c7037f4c95 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
602025-01-16T23:30:15.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d7e8588e-1269-4e63-938e-c9c7037f4c95 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
612025-01-16T23:30:15.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d7e8588e-1269-4e63-938e-c9c7037f4c95 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
622025-01-16T23:30:15.730ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 591 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = b78e3d4c-a12e-480a-8acf-6749b8d402de response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
632025-01-16T23:30:16.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 010e17bc-08ec-45b5-ac44-3d69c79de060 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
642025-01-16T23:30:16.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 010e17bc-08ec-45b5-ac44-3d69c79de060 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
652025-01-16T23:30:16.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 010e17bc-08ec-45b5-ac44-3d69c79de060 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
662025-01-16T23:30:16.999ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
672025-01-16T23:30:16.999ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
682025-01-16T23:30:16.999ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
692025-01-16T23:30:16.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
702025-01-16T23:30:16.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
712025-01-16T23:30:16.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
722025-01-16T23:30:17.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
732025-01-16T23:30:17.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
742025-01-16T23:30:17.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
752025-01-16T23:30:17.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
762025-01-16T23:30:17.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
772025-01-16T23:30:17.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
782025-01-16T23:30:17.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
792025-01-16T23:30:17.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
802025-01-16T23:30:17.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
812025-01-16T23:30:17.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
822025-01-16T23:30:17.029ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
832025-01-16T23:30:17.029ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.268521ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
842025-01-16T23:30:17.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
852025-01-16T23:30:17.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
862025-01-16T23:30:17.060ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.142845ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
872025-01-16T23:30:17.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b54f9bbe-1ce2-43f3-97a8-3bb59b550a78 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
882025-01-16T23:30:17.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b54f9bbe-1ce2-43f3-97a8-3bb59b550a78 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
892025-01-16T23:30:17.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b54f9bbe-1ce2-43f3-97a8-3bb59b550a78 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
902025-01-16T23:30:18.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6259fa37-b061-486d-83ec-895412e24504 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
912025-01-16T23:30:18.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6259fa37-b061-486d-83ec-895412e24504 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
922025-01-16T23:30:18.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6259fa37-b061-486d-83ec-895412e24504 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
932025-01-16T23:30:19.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9fa192d8-7173-4f6f-abb4-91668c9467f0 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
942025-01-16T23:30:19.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9fa192d8-7173-4f6f-abb4-91668c9467f0 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
952025-01-16T23:30:19.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9fa192d8-7173-4f6f-abb4-91668c9467f0 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
962025-01-16T23:30:20.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 369f153d-a3eb-4deb-a3ec-c647a7d7c1ce roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
972025-01-16T23:30:20.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 369f153d-a3eb-4deb-a3ec-c647a7d7c1ce resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
982025-01-16T23:30:20.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 369f153d-a3eb-4deb-a3ec-c647a7d7c1ce response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
992025-01-16T23:30:20.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 68057171-9e8c-47a3-aa22-bdbc869f6733 roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
1002025-01-16T23:30:20.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 68057171-9e8c-47a3-aa22-bdbc869f6733 resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
1012025-01-16T23:30:20.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 68057171-9e8c-47a3-aa22-bdbc869f6733 response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
1022025-01-16T23:30:20.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 73e3bda1-9daa-413e-bf05-558193eab4a2 roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
1032025-01-16T23:30:20.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 73e3bda1-9daa-413e-bf05-558193eab4a2 resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
1042025-01-16T23:30:20.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 73e3bda1-9daa-413e-bf05-558193eab4a2 response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
1052025-01-16T23:30:21.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8d58393e-a11e-4db5-86c6-f257f61b8f7a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1062025-01-16T23:30:21.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8d58393e-a11e-4db5-86c6-f257f61b8f7a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1072025-01-16T23:30:21.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8d58393e-a11e-4db5-86c6-f257f61b8f7a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1082025-01-16T23:30:22.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d5b6a0f7-15e4-4f82-96c8-db36576fcaa5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1092025-01-16T23:30:22.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d5b6a0f7-15e4-4f82-96c8-db36576fcaa5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1102025-01-16T23:30:22.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d5b6a0f7-15e4-4f82-96c8-db36576fcaa5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1112025-01-16T23:30:23.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 14ab8b53-d8be-4958-ba22-3d6e77971880 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1122025-01-16T23:30:23.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 14ab8b53-d8be-4958-ba22-3d6e77971880 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1132025-01-16T23:30:23.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 14ab8b53-d8be-4958-ba22-3d6e77971880 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1142025-01-16T23:30:24.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2042868c-3ac0-4563-975c-e3c397596a88 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1152025-01-16T23:30:24.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2042868c-3ac0-4563-975c-e3c397596a88 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1162025-01-16T23:30:24.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2042868c-3ac0-4563-975c-e3c397596a88 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1172025-01-16T23:30:25.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4a85b5af-236d-4852-a6a5-475a923f28d4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1182025-01-16T23:30:25.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4a85b5af-236d-4852-a6a5-475a923f28d4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1192025-01-16T23:30:25.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4a85b5af-236d-4852-a6a5-475a923f28d4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1202025-01-16T23:30:25.730ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 548 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = eccb5d50-df30-42b2-939a-e34bc4945d78 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
1212025-01-16T23:30:26.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5e9f0fe0-fe44-45d7-ac44-fd52802b3aad roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1222025-01-16T23:30:26.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5e9f0fe0-fe44-45d7-ac44-fd52802b3aad resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1232025-01-16T23:30:26.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5e9f0fe0-fe44-45d7-ac44-fd52802b3aad response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
1242025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
1252025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1262025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
1272025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1282025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
1292025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
1302025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
1312025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1322025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1332025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
1342025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
1352025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1362025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1372025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
1382025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
1392025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1402025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
1412025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1422025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
1432025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
1442025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1452025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1462025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1472025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
1482025-01-16T23:30:26.999ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
1492025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
1502025-01-16T23:30:27.000ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-16 23:20:26.999947960 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1512025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1522025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
1532025-01-16T23:30:27.000ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca
1542025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
1552025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.95\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca"}
1562025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1572025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
1582025-01-16T23:30:27.000ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1592025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
1602025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1612025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1622025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
1632025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
1642025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
1652025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1662025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1672025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1682025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
1692025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
1702025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
1712025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1722025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1732025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1742025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
1752025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1762025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
1772025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1782025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
1792025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1802025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
1812025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1822025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 13 reason = Timeout
1832025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
1842025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1852025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1862025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1872025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
1882025-01-16T23:30:27.000ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1892025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1902025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1912025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1922025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1932025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1942025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1952025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1962025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1972025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1982025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1992025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2002025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2012025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
2022025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2032025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2042025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2052025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
2062025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
2072025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2082025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2092025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2102025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2112025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
2122025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2132025-01-16T23:30:27.000ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dc5f3810-93b6-44f1-815c-44411abf99ad.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 318273707 } })
2142025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2152025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2162025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2172025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2182025-01-16T23:30:27.000ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5c1ab32c-50b8-4564-bf29-e388b915cbdb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd10c057-8c9f-4db2-98b5-bcf5e0d536ba.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 318323958 } })
2192025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2202025-01-16T23:30:27.000ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2212025-01-16T23:30:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2222025-01-16T23:30:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2232025-01-16T23:30:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2242025-01-16T23:30:27.001ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2252025-01-16T23:30:27.001ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
2262025-01-16T23:30:27.001ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.529069ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
2272025-01-16T23:30:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2282025-01-16T23:30:27.001ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
2292025-01-16T23:30:27.001ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.447467ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
2302025-01-16T23:30:27.002ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2312025-01-16T23:30:27.003ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.520268ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2322025-01-16T23:30:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2332025-01-16T23:30:27.004ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2342025-01-16T23:30:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2352025-01-16T23:30:27.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2362025-01-16T23:30:27.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2372025-01-16T23:30:27.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.332716ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
2382025-01-16T23:30:27.015ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-16 23:20:26.999947960 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2392025-01-16T23:30:27.015ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.362805ms iteration = 7 status = {"expiration":"2025-01-16T23:20:26.999947960Z","pruned":[]}
2402025-01-16T23:30:27.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2412025-01-16T23:30:27.017ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 334553800 } })
2422025-01-16T23:30:27.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2432025-01-16T23:30:27.017ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
2442025-01-16T23:30:27.017ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.456135ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
2452025-01-16T23:30:27.017ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 335298144 } })
2462025-01-16T23:30:27.018ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
2472025-01-16T23:30:27.018ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2482025-01-16T23:30:27.018ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2492025-01-16T23:30:27.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2502025-01-16T23:30:27.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2512025-01-16T23:30:27.021ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2522025-01-16T23:30:27.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2532025-01-16T23:30:27.021ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2542025-01-16T23:30:27.021ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2552025-01-16T23:30:27.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2562025-01-16T23:30:27.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2572025-01-16T23:30:27.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2582025-01-16T23:30:27.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2592025-01-16T23:30:27.027ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2602025-01-16T23:30:27.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2612025-01-16T23:30:27.029ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2622025-01-16T23:30:27.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2632025-01-16T23:30:27.031ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2642025-01-16T23:30:27.032ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2652025-01-16T23:30:27.032ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2662025-01-16T23:30:27.032ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2672025-01-16T23:30:27.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2682025-01-16T23:30:27.032ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2692025-01-16T23:30:27.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2702025-01-16T23:30:27.035ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2712025-01-16T23:30:27.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2722025-01-16T23:30:27.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2732025-01-16T23:30:27.036ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2742025-01-16T23:30:27.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2752025-01-16T23:30:27.036ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2762025-01-16T23:30:27.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2772025-01-16T23:30:27.040ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2782025-01-16T23:30:27.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2792025-01-16T23:30:27.044ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2802025-01-16T23:30:27.044ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2812025-01-16T23:30:27.044ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2822025-01-16T23:30:27.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2832025-01-16T23:30:27.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2842025-01-16T23:30:27.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2852025-01-16T23:30:27.047ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2862025-01-16T23:30:27.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2872025-01-16T23:30:27.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.282176ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
2882025-01-16T23:30:27.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2892025-01-16T23:30:27.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2902025-01-16T23:30:27.053ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 370902618 } })
2912025-01-16T23:30:27.053ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
2922025-01-16T23:30:27.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2932025-01-16T23:30:27.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2942025-01-16T23:30:27.063ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2952025-01-16T23:30:27.063ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2962025-01-16T23:30:27.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2972025-01-16T23:30:27.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2982025-01-16T23:30:27.064ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2992025-01-16T23:30:27.065ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
3002025-01-16T23:30:27.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
3012025-01-16T23:30:27.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3022025-01-16T23:30:27.067ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3032025-01-16T23:30:27.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3042025-01-16T23:30:27.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3052025-01-16T23:30:27.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3062025-01-16T23:30:27.068ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3072025-01-16T23:30:27.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3082025-01-16T23:30:27.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3092025-01-16T23:30:27.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3102025-01-16T23:30:27.068ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3112025-01-16T23:30:27.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3122025-01-16T23:30:27.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3132025-01-16T23:30:27.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3142025-01-16T23:30:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
3152025-01-16T23:30:27.070ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3162025-01-16T23:30:27.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3172025-01-16T23:30:27.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3182025-01-16T23:30:27.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3192025-01-16T23:30:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3202025-01-16T23:30:27.070ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
3212025-01-16T23:30:27.070ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
3222025-01-16T23:30:27.070ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 70.573995ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
3232025-01-16T23:30:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3242025-01-16T23:30:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3252025-01-16T23:30:27.071ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3262025-01-16T23:30:27.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3272025-01-16T23:30:27.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3282025-01-16T23:30:27.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3292025-01-16T23:30:27.072ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 73.145764ms iteration = 4 status = {"nsuccess":5}
3302025-01-16T23:30:27.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3312025-01-16T23:30:27.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3322025-01-16T23:30:27.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3332025-01-16T23:30:27.073ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3342025-01-16T23:30:27.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3352025-01-16T23:30:27.074ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3362025-01-16T23:30:27.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3372025-01-16T23:30:27.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3382025-01-16T23:30:27.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3392025-01-16T23:30:27.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3402025-01-16T23:30:27.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3412025-01-16T23:30:27.077ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3422025-01-16T23:30:27.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3432025-01-16T23:30:27.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
3442025-01-16T23:30:27.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3452025-01-16T23:30:27.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3462025-01-16T23:30:27.079ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3472025-01-16T23:30:27.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3482025-01-16T23:30:27.080ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3492025-01-16T23:30:27.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
3502025-01-16T23:30:27.082ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
3512025-01-16T23:30:27.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
3522025-01-16T23:30:27.095ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
3532025-01-16T23:30:27.095ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 95.525685ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
3542025-01-16T23:30:27.097ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
3552025-01-16T23:30:27.097ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 97.623575ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
3562025-01-16T23:30:27.098ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3572025-01-16T23:30:27.098ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3582025-01-16T23:30:27.098ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3592025-01-16T23:30:27.098ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3602025-01-16T23:30:27.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3612025-01-16T23:30:27.102ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3622025-01-16T23:30:27.102ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3632025-01-16T23:30:27.102ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3642025-01-16T23:30:27.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3652025-01-16T23:30:27.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3662025-01-16T23:30:27.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3672025-01-16T23:30:27.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3682025-01-16T23:30:27.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.138949ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3692025-01-16T23:30:27.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3702025-01-16T23:30:27.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3712025-01-16T23:30:27.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3722025-01-16T23:30:27.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3732025-01-16T23:30:27.107ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3742025-01-16T23:30:27.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3752025-01-16T23:30:27.109ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3762025-01-16T23:30:27.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3772025-01-16T23:30:27.112ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3782025-01-16T23:30:27.112ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3792025-01-16T23:30:27.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3802025-01-16T23:30:27.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3812025-01-16T23:30:27.112ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3822025-01-16T23:30:27.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3832025-01-16T23:30:27.115ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3842025-01-16T23:30:27.115ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3852025-01-16T23:30:27.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3862025-01-16T23:30:27.119ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3872025-01-16T23:30:27.119ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
3882025-01-16T23:30:27.119ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 118.940255ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3892025-01-16T23:30:27.119ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 119.426263ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3902025-01-16T23:30:27.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
3912025-01-16T23:30:27.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3922025-01-16T23:30:27.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3932025-01-16T23:30:27.121ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3942025-01-16T23:30:27.121ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3952025-01-16T23:30:27.122ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3962025-01-16T23:30:27.122ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3972025-01-16T23:30:27.122ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.879991ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3982025-01-16T23:30:27.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3992025-01-16T23:30:27.122ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 122.444651ms iteration = 13 status = 0
4002025-01-16T23:30:27.123ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4012025-01-16T23:30:27.124ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4022025-01-16T23:30:27.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4032025-01-16T23:30:27.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 124.526051ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
4042025-01-16T23:30:27.125ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4052025-01-16T23:30:27.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4062025-01-16T23:30:27.130ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
4072025-01-16T23:30:27.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
4082025-01-16T23:30:27.136ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4092025-01-16T23:30:27.138ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4102025-01-16T23:30:27.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
4112025-01-16T23:30:27.138ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
4122025-01-16T23:30:27.139ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4132025-01-16T23:30:27.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
4142025-01-16T23:30:27.146ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
4152025-01-16T23:30:27.146ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 0 version = 2
4162025-01-16T23:30:27.146ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4172025-01-16T23:30:27.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4182025-01-16T23:30:27.148ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4192025-01-16T23:30:27.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4202025-01-16T23:30:27.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4212025-01-16T23:30:27.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4222025-01-16T23:30:27.152ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4232025-01-16T23:30:27.154ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 1 version = 2
4242025-01-16T23:30:27.154ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
4252025-01-16T23:30:27.154ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-16 23:25:21.695734 UTC dns_group = external generation = 2
4262025-01-16T23:30:27.154ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 154.238122ms iteration = 7 status = {"generation":2}
4272025-01-16T23:30:27.156ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4282025-01-16T23:30:27.156ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4292025-01-16T23:30:27.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4302025-01-16T23:30:27.159ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
4312025-01-16T23:30:27.159ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
4322025-01-16T23:30:27.159ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-16 23:25:20.756297 UTC dns_group = internal generation = 1
4332025-01-16T23:30:27.159ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 159.576584ms iteration = 7 status = {"generation":1}
4342025-01-16T23:30:27.160ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
4352025-01-16T23:30:27.160ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4362025-01-16T23:30:27.160ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "10379d49-e897-402d-9f01-6417ef58a355", "content-length": "26", "date": "Thu, 16 Jan 2025 23:30:26 GMT"} })
4372025-01-16T23:30:27.160ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4382025-01-16T23:30:27.162ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4392025-01-16T23:30:27.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 166.881505ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
4402025-01-16T23:30:27.170ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
4412025-01-16T23:30:27.170ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 170.678638ms iteration = 13 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
4422025-01-16T23:30:27.173ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-16T23:24:20.471931Z, time_modified: 2025-01-16T23:24:20.471931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }) }
4432025-01-16T23:30:27.173ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 173.600334ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]}},"default_endpoint":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4442025-01-16T23:30:27.184ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
4452025-01-16T23:30:27.184ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4462025-01-16T23:30:27.185ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db0dc454-beee-4ace-9d14-cca987ab9224", "content-length": "26", "date": "Thu, 16 Jan 2025 23:30:26 GMT"} })
4472025-01-16T23:30:27.185ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4482025-01-16T23:30:27.186ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4492025-01-16T23:30:27.192ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4502025-01-16T23:30:27.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4512025-01-16T23:30:27.194ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4522025-01-16T23:30:27.196ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4532025-01-16T23:30:27.196ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4542025-01-16T23:30:27.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4552025-01-16T23:30:27.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4562025-01-16T23:30:27.202ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4572025-01-16T23:30:27.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4582025-01-16T23:30:27.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4592025-01-16T23:30:27.211ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 211.789308ms iteration = 15 status = {"physical_disks_added":0}
4602025-01-16T23:30:27.217ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
4612025-01-16T23:30:27.217ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4622025-01-16T23:30:27.217ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d96a660-1777-4212-ab80-4f738f7536fa", "content-length": "26", "date": "Thu, 16 Jan 2025 23:30:26 GMT"} })
4632025-01-16T23:30:27.217ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4642025-01-16T23:30:27.219ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
4652025-01-16T23:30:27.223ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
4662025-01-16T23:30:27.223ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 223.521603ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4672025-01-16T23:30:27.326ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4682025-01-16T23:30:27.332ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
4692025-01-16T23:30:27.333ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a32016a7-10e1-48a8-8b4c-fdddd17ea1aa", "date": "Thu, 16 Jan 2025 23:30:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4702025-01-16T23:30:27.333ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4712025-01-16T23:30:27.334ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "af2c3bbe-28e3-49ac-8145-54f81e81d1d2", "date": "Thu, 16 Jan 2025 23:30:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4722025-01-16T23:30:27.334ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4732025-01-16T23:30:27.336ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4742025-01-16T23:30:27.336ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 336.765558ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4752025-01-16T23:30:27.366ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 366.903107ms iteration = 13 status = {}
4762025-01-16T23:30:27.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 29ed5687-38f8-43ac-b7be-49840f8f3942 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
4772025-01-16T23:30:27.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 29ed5687-38f8-43ac-b7be-49840f8f3942 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
4782025-01-16T23:30:27.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 29ed5687-38f8-43ac-b7be-49840f8f3942 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
4792025-01-16T23:30:27.473ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
4802025-01-16T23:30:27.473ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2c76154c-4dd2-40a8-8684-29d9968899e3", "date": "Thu, 16 Jan 2025 23:30:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4812025-01-16T23:30:27.473ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4822025-01-16T23:30:27.475ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4448faf9-2d87-4b3b-97cd-bd9005c6f9da", "date": "Thu, 16 Jan 2025 23:30:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4832025-01-16T23:30:27.475ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4842025-01-16T23:30:27.477ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "52311c06-13c2-44b5-a896-98f169dd779e", "date": "Thu, 16 Jan 2025 23:30:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4852025-01-16T23:30:27.477ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4862025-01-16T23:30:27.478ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4872025-01-16T23:30:27.478ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 478.99728ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4882025-01-16T23:30:27.540ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4892025-01-16T23:30:27.540ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4902025-01-16T23:30:27.540ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "413e606a-3f14-44d8-b3d8-792c465cf667", "content-length": "372", "date": "Thu, 16 Jan 2025 23:30:27 GMT"} })
4912025-01-16T23:30:27.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4922025-01-16T23:30:27.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4932025-01-16T23:30:27.554ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
4942025-01-16T23:30:27.554ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4952025-01-16T23:30:27.554ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3331dc0c-6c50-417f-8d4f-d49537c61a79", "date": "Thu, 16 Jan 2025 23:30:27 GMT"} })
4962025-01-16T23:30:27.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4972025-01-16T23:30:27.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4982025-01-16T23:30:27.567ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4992025-01-16T23:30:27.567ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "99550da9-b33b-4e95-b9bd-1c4bcf721444", "content-length": "1", "date": "Thu, 16 Jan 2025 23:30:27 GMT"} })
5002025-01-16T23:30:27.568ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5012025-01-16T23:30:27.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5022025-01-16T23:30:27.569ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
5032025-01-16T23:30:27.570ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "76f8fcf4-8c94-4612-94a2-8298b7957670", "content-length": "691", "date": "Thu, 16 Jan 2025 23:30:27 GMT"} })
5042025-01-16T23:30:27.570ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
5052025-01-16T23:30:27.570ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
5062025-01-16T23:30:27.570ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
5072025-01-16T23:30:27.571ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 571.741101ms iteration = 13 status = {}
5082025-01-16T23:30:27.571ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 571.748541ms iteration = 13 status = null
5092025-01-16T23:30:27.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5102025-01-16T23:30:27.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5112025-01-16T23:30:27.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5122025-01-16T23:30:27.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5132025-01-16T23:30:27.578ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
5142025-01-16T23:30:27.578ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
5152025-01-16T23:30:27.579ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6933d695-fa97-47d5-8fa8-7161a742103c", "date": "Thu, 16 Jan 2025 23:30:27 GMT"} })
5162025-01-16T23:30:27.581ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 581.356115ms iteration = 13 status = {}
5172025-01-16T23:30:27.584ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5182025-01-16T23:30:27.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5192025-01-16T23:30:27.586ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
5202025-01-16T23:30:27.586ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5212025-01-16T23:30:27.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5222025-01-16T23:30:27.596ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
5232025-01-16T23:30:27.596ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2ac4483-8357-4ee7-b844-0e20e759eafe", "content-length": "134", "date": "Thu, 16 Jan 2025 23:30:27 GMT"} })
5242025-01-16T23:30:27.596ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
5252025-01-16T23:30:27.596ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
5262025-01-16T23:30:27.596ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
5272025-01-16T23:30:27.596ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5282025-01-16T23:30:27.596ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5292025-01-16T23:30:27.596ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5302025-01-16T23:30:27.596ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5312025-01-16T23:30:27.596ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5322025-01-16T23:30:27.596ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5332025-01-16T23:30:27.596ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5342025-01-16T23:30:27.597ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
5352025-01-16T23:30:27.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5362025-01-16T23:30:27.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5372025-01-16T23:30:27.599ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
5382025-01-16T23:30:27.599ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "07e7e089-719a-4e26-afd4-183be5c8c92b", "content-length": "2", "date": "Thu, 16 Jan 2025 23:30:27 GMT"} })
5392025-01-16T23:30:27.599ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
5402025-01-16T23:30:27.599ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "faa6efba-024f-4f6d-9527-09e1d7043eb4", "content-length": "52", "date": "Thu, 16 Jan 2025 23:30:27 GMT"} })
5412025-01-16T23:30:27.599ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
5422025-01-16T23:30:27.599ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
5432025-01-16T23:30:27.692ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "32f5fb1f-0c06-4635-bbbc-57ec6dc7b626", "date": "Thu, 16 Jan 2025 23:30:27 GMT"} })
5442025-01-16T23:30:27.693ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
5452025-01-16T23:30:27.693ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5462025-01-16T23:30:27.693ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e1cf906-f54f-4927-8772-ce59ba358934", "content-length": "682", "date": "Thu, 16 Jan 2025 23:30:27 GMT"} })
5472025-01-16T23:30:27.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5482025-01-16T23:30:27.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5492025-01-16T23:30:27.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5502025-01-16T23:30:27.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5512025-01-16T23:30:27.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5522025-01-16T23:30:27.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5532025-01-16T23:30:27.702ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5542025-01-16T23:30:27.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5552025-01-16T23:30:27.709ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 709.527416ms iteration = 13 status = {}
5562025-01-16T23:30:27.933ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
5572025-01-16T23:30:27.933ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
5582025-01-16T23:30:27.964ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
5592025-01-16T23:30:27.964ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:62906
5602025-01-16T23:30:27.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62906 req_id = a125afcd-0a23-48ae-b199-a394a5be6885 roles = RoleSet { roles: {} } uri = /metrics/producers
5612025-01-16T23:30:27.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62906 req_id = a125afcd-0a23-48ae-b199-a394a5be6885 resource = Database result = Ok(()) uri = /metrics/producers
5622025-01-16T23:30:28.001ZINFOnexus: assigned collector to new producer collector_id = 0a365f9e-6c70-4a27-ba2b-6123ad53013e file = nexus/src/app/oximeter.rs:76 producer_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
5632025-01-16T23:30:28.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37587 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62906 req_id = a125afcd-0a23-48ae-b199-a394a5be6885 response_code = 201 uri = /metrics/producers
5642025-01-16T23:30:28.002ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "a125afcd-0a23-48ae-b199-a394a5be6885", "content-length": "41", "date": "Thu, 16 Jan 2025 23:30:27 GMT"} })
5652025-01-16T23:30:28.003ZDEBGnexus (producer-registration-task): registered with nexus successfully
5662025-01-16T23:30:28.003ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
5672025-01-16T23:30:28.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c08b9fe5-1f98-4a13-a93f-768646e51582 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5682025-01-16T23:30:28.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c08b9fe5-1f98-4a13-a93f-768646e51582 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5692025-01-16T23:30:28.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c08b9fe5-1f98-4a13-a93f-768646e51582 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5702025-01-16T23:30:29.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3f6ac183-101a-4002-ac52-de7c588b26e0 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5712025-01-16T23:30:29.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3f6ac183-101a-4002-ac52-de7c588b26e0 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5722025-01-16T23:30:29.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3f6ac183-101a-4002-ac52-de7c588b26e0 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5732025-01-16T23:30:30.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0cd81317-15ab-4afd-ac4b-66513ed73da3 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5742025-01-16T23:30:30.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0cd81317-15ab-4afd-ac4b-66513ed73da3 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5752025-01-16T23:30:30.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0cd81317-15ab-4afd-ac4b-66513ed73da3 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5762025-01-16T23:30:31.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 285a1982-08ea-4344-acd7-0163b9f4ea31 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5772025-01-16T23:30:31.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 285a1982-08ea-4344-acd7-0163b9f4ea31 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5782025-01-16T23:30:31.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 285a1982-08ea-4344-acd7-0163b9f4ea31 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5792025-01-16T23:30:32.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c06382d9-9c59-4fed-8ce1-d4b02080b68f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5802025-01-16T23:30:32.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c06382d9-9c59-4fed-8ce1-d4b02080b68f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5812025-01-16T23:30:32.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c06382d9-9c59-4fed-8ce1-d4b02080b68f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5822025-01-16T23:30:33.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7c0c788a-414f-4fcb-b31a-2d61e21ca873 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5832025-01-16T23:30:33.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7c0c788a-414f-4fcb-b31a-2d61e21ca873 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5842025-01-16T23:30:33.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7c0c788a-414f-4fcb-b31a-2d61e21ca873 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5852025-01-16T23:30:34.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 902441dd-fcc1-421c-ad67-d8fb0354107b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5862025-01-16T23:30:34.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 902441dd-fcc1-421c-ad67-d8fb0354107b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5872025-01-16T23:30:34.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 902441dd-fcc1-421c-ad67-d8fb0354107b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5882025-01-16T23:30:35.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3e86f82e-7d54-4cae-8eee-8087c1f7e0b5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5892025-01-16T23:30:35.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3e86f82e-7d54-4cae-8eee-8087c1f7e0b5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5902025-01-16T23:30:35.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3e86f82e-7d54-4cae-8eee-8087c1f7e0b5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5912025-01-16T23:30:35.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 0ae9bcc0-027d-451f-a437-d10410da09ae roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
5922025-01-16T23:30:35.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 0ae9bcc0-027d-451f-a437-d10410da09ae resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
5932025-01-16T23:30:35.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 0ae9bcc0-027d-451f-a437-d10410da09ae response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
5942025-01-16T23:30:35.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 1b5e7fcd-7e45-4549-92ef-62aaa1736d0b roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
5952025-01-16T23:30:35.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 1b5e7fcd-7e45-4549-92ef-62aaa1736d0b resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
5962025-01-16T23:30:35.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 1b5e7fcd-7e45-4549-92ef-62aaa1736d0b response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
5972025-01-16T23:30:35.730ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 468 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 2b78c918-8952-4447-a63b-2993bf46ee98 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
5982025-01-16T23:30:36.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c9103779-dcc8-4a7c-9a80-f9e867b42882 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
5992025-01-16T23:30:36.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c9103779-dcc8-4a7c-9a80-f9e867b42882 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6002025-01-16T23:30:36.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c9103779-dcc8-4a7c-9a80-f9e867b42882 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6012025-01-16T23:30:36.999ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
6022025-01-16T23:30:36.999ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6032025-01-16T23:30:36.999ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
6042025-01-16T23:30:36.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6052025-01-16T23:30:36.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6062025-01-16T23:30:36.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6072025-01-16T23:30:37.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6082025-01-16T23:30:37.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6092025-01-16T23:30:37.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6102025-01-16T23:30:37.002ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.808553ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6112025-01-16T23:30:37.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6122025-01-16T23:30:37.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6132025-01-16T23:30:37.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6142025-01-16T23:30:37.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6152025-01-16T23:30:37.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6162025-01-16T23:30:37.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6172025-01-16T23:30:37.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
6182025-01-16T23:30:37.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6192025-01-16T23:30:37.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6202025-01-16T23:30:37.017ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
6212025-01-16T23:30:37.017ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.675179ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
6222025-01-16T23:30:37.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e5da8c0a-0838-4cf4-9d7a-63a6d229cc89 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6232025-01-16T23:30:37.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e5da8c0a-0838-4cf4-9d7a-63a6d229cc89 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6242025-01-16T23:30:37.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e5da8c0a-0838-4cf4-9d7a-63a6d229cc89 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6252025-01-16T23:30:38.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4a098960-d1e0-44df-9d4b-702dfc822e8b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6262025-01-16T23:30:38.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4a098960-d1e0-44df-9d4b-702dfc822e8b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6272025-01-16T23:30:38.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4a098960-d1e0-44df-9d4b-702dfc822e8b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6282025-01-16T23:30:39.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 74558332-def2-4ce7-93e9-75fbcbe17fb5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6292025-01-16T23:30:39.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 74558332-def2-4ce7-93e9-75fbcbe17fb5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6302025-01-16T23:30:39.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 74558332-def2-4ce7-93e9-75fbcbe17fb5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6312025-01-16T23:30:40.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cebfc9a8-e9bb-48ec-89f8-404af0485d2f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6322025-01-16T23:30:40.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cebfc9a8-e9bb-48ec-89f8-404af0485d2f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6332025-01-16T23:30:40.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cebfc9a8-e9bb-48ec-89f8-404af0485d2f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6342025-01-16T23:30:41.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = eaa7b05b-9a32-4861-b446-f3e28dab73c8 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6352025-01-16T23:30:41.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = eaa7b05b-9a32-4861-b446-f3e28dab73c8 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6362025-01-16T23:30:41.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = eaa7b05b-9a32-4861-b446-f3e28dab73c8 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6372025-01-16T23:30:42.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c9287d21-f013-44f3-94df-e58bf944f381 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6382025-01-16T23:30:42.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c9287d21-f013-44f3-94df-e58bf944f381 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6392025-01-16T23:30:42.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c9287d21-f013-44f3-94df-e58bf944f381 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6402025-01-16T23:30:43.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f4fa588a-83df-48c2-bee6-f022ccadce88 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6412025-01-16T23:30:43.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f4fa588a-83df-48c2-bee6-f022ccadce88 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6422025-01-16T23:30:43.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f4fa588a-83df-48c2-bee6-f022ccadce88 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6432025-01-16T23:30:44.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a44b7f2a-5cec-45a2-ba0a-46a02033394d roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6442025-01-16T23:30:44.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a44b7f2a-5cec-45a2-ba0a-46a02033394d resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6452025-01-16T23:30:44.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a44b7f2a-5cec-45a2-ba0a-46a02033394d response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6462025-01-16T23:30:45.731ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 559 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 6940dda6-282b-4820-b91c-ab8cb0331861 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
6472025-01-16T23:30:45.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a2ebe300-6600-4057-aa6e-f44edd6e19e1 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6482025-01-16T23:30:45.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a2ebe300-6600-4057-aa6e-f44edd6e19e1 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6492025-01-16T23:30:45.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a2ebe300-6600-4057-aa6e-f44edd6e19e1 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6502025-01-16T23:30:46.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e17b2871-a04a-4590-838d-6afd3b165cb0 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6512025-01-16T23:30:46.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e17b2871-a04a-4590-838d-6afd3b165cb0 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6522025-01-16T23:30:46.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e17b2871-a04a-4590-838d-6afd3b165cb0 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6532025-01-16T23:30:46.999ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
6542025-01-16T23:30:46.999ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6552025-01-16T23:30:46.999ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
6562025-01-16T23:30:46.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6572025-01-16T23:30:46.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6582025-01-16T23:30:46.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6592025-01-16T23:30:47.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6602025-01-16T23:30:47.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6612025-01-16T23:30:47.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6622025-01-16T23:30:47.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6632025-01-16T23:30:47.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6642025-01-16T23:30:47.004ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.814192ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6652025-01-16T23:30:47.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6662025-01-16T23:30:47.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6672025-01-16T23:30:47.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6682025-01-16T23:30:47.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6692025-01-16T23:30:47.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
6702025-01-16T23:30:47.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6712025-01-16T23:30:47.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6722025-01-16T23:30:47.019ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
6732025-01-16T23:30:47.019ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.852241ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
6742025-01-16T23:30:47.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8d9eec7b-500f-42a1-972c-22863937dc81 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6752025-01-16T23:30:47.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8d9eec7b-500f-42a1-972c-22863937dc81 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6762025-01-16T23:30:47.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8d9eec7b-500f-42a1-972c-22863937dc81 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6772025-01-16T23:30:48.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2378d564-225f-43a7-8a56-05eda179b0ce roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6782025-01-16T23:30:48.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2378d564-225f-43a7-8a56-05eda179b0ce resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6792025-01-16T23:30:48.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2378d564-225f-43a7-8a56-05eda179b0ce response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6802025-01-16T23:30:49.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4c1ee772-173f-4df4-a924-b5c0737fcda0 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6812025-01-16T23:30:49.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4c1ee772-173f-4df4-a924-b5c0737fcda0 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6822025-01-16T23:30:49.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4c1ee772-173f-4df4-a924-b5c0737fcda0 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6832025-01-16T23:30:50.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 90019409-2e3e-4ab9-aea0-43a8e2e3c0ef roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6842025-01-16T23:30:50.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 90019409-2e3e-4ab9-aea0-43a8e2e3c0ef resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6852025-01-16T23:30:50.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 90019409-2e3e-4ab9-aea0-43a8e2e3c0ef response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6862025-01-16T23:30:51.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 95ab155d-9bb5-4988-956c-3c40eef78ac5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6872025-01-16T23:30:51.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 95ab155d-9bb5-4988-956c-3c40eef78ac5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6882025-01-16T23:30:51.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 95ab155d-9bb5-4988-956c-3c40eef78ac5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6892025-01-16T23:30:52.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8b60820c-1727-43e6-8a08-1d2a45b6d4c2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6902025-01-16T23:30:52.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8b60820c-1727-43e6-8a08-1d2a45b6d4c2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6912025-01-16T23:30:52.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8b60820c-1727-43e6-8a08-1d2a45b6d4c2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6922025-01-16T23:30:54.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3cfa0bfb-3591-4672-95c9-1b9fe1714b45 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6932025-01-16T23:30:54.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3cfa0bfb-3591-4672-95c9-1b9fe1714b45 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6942025-01-16T23:30:54.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3cfa0bfb-3591-4672-95c9-1b9fe1714b45 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6952025-01-16T23:30:55.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a03d4a8e-26d9-4d06-a9b4-b7583452acde roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6962025-01-16T23:30:55.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a03d4a8e-26d9-4d06-a9b4-b7583452acde resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6972025-01-16T23:30:55.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a03d4a8e-26d9-4d06-a9b4-b7583452acde response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
6982025-01-16T23:30:55.730ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 568 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 6b85e67f-e959-483a-998f-ed4b46ec204e response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
6992025-01-16T23:30:56.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 26b8859c-61b6-4d30-a65f-ecb1a8bbcd1d roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
7002025-01-16T23:30:56.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 26b8859c-61b6-4d30-a65f-ecb1a8bbcd1d resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
7012025-01-16T23:30:56.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 26b8859c-61b6-4d30-a65f-ecb1a8bbcd1d response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
7022025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
7032025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7042025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
7052025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7062025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
7072025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
7082025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7092025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7102025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
7112025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
7122025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
7132025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7142025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7152025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
7162025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
7172025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
7182025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7192025-01-16T23:30:56.999ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
7202025-01-16T23:30:56.999ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
7212025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7222025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
7232025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7242025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
7252025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7262025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
7272025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
7282025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7292025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7302025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
7312025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
7322025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
7332025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
7342025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7352025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
7362025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7372025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
7382025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
7392025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7402025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7412025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7422025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7432025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7442025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
7452025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7462025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7472025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7482025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7492025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
7502025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7512025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7522025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7532025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7542025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7552025-01-16T23:30:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7562025-01-16T23:30:57.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7572025-01-16T23:30:57.002ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7582025-01-16T23:30:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7592025-01-16T23:30:57.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7602025-01-16T23:30:57.003ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7612025-01-16T23:30:57.004ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.079448ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
7622025-01-16T23:30:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7632025-01-16T23:30:57.004ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7642025-01-16T23:30:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7652025-01-16T23:30:57.005ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1365, tv_nsec: 322411246 } })
7662025-01-16T23:30:57.005ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
7672025-01-16T23:30:57.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7682025-01-16T23:30:57.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7692025-01-16T23:30:57.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7702025-01-16T23:30:57.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7712025-01-16T23:30:57.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7722025-01-16T23:30:57.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7732025-01-16T23:30:57.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7742025-01-16T23:30:57.009ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7752025-01-16T23:30:57.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7762025-01-16T23:30:57.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7772025-01-16T23:30:57.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7782025-01-16T23:30:57.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7792025-01-16T23:30:57.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7802025-01-16T23:30:57.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7812025-01-16T23:30:57.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7822025-01-16T23:30:57.012ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7832025-01-16T23:30:57.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7842025-01-16T23:30:57.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7852025-01-16T23:30:57.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7862025-01-16T23:30:57.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7872025-01-16T23:30:57.013ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7882025-01-16T23:30:57.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7892025-01-16T23:30:57.015ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1365, tv_nsec: 332474980 } })
7902025-01-16T23:30:57.015ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
7912025-01-16T23:30:57.021ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7922025-01-16T23:30:57.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7932025-01-16T23:30:57.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7942025-01-16T23:30:57.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7952025-01-16T23:30:57.026ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1365, tv_nsec: 344145024 } })
7962025-01-16T23:30:57.027ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
7972025-01-16T23:30:57.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7982025-01-16T23:30:57.030ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7992025-01-16T23:30:57.030ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8002025-01-16T23:30:57.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8012025-01-16T23:30:57.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8022025-01-16T23:30:57.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8032025-01-16T23:30:57.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8042025-01-16T23:30:57.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8052025-01-16T23:30:57.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8062025-01-16T23:30:57.035ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8072025-01-16T23:30:57.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
8082025-01-16T23:30:57.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8092025-01-16T23:30:57.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8102025-01-16T23:30:57.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8112025-01-16T23:30:57.048ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8122025-01-16T23:30:57.048ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
8132025-01-16T23:30:57.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8142025-01-16T23:30:57.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8152025-01-16T23:30:57.055ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
8162025-01-16T23:30:57.055ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8172025-01-16T23:30:57.055ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e24f82f3-47ff-46ce-8a0e-b4dd591529da", "content-length": "26", "date": "Thu, 16 Jan 2025 23:30:57 GMT"} })
8182025-01-16T23:30:57.055ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8192025-01-16T23:30:57.055ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
8202025-01-16T23:30:57.055ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.000826ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
8212025-01-16T23:30:57.056ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8222025-01-16T23:30:57.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8232025-01-16T23:30:57.057ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8242025-01-16T23:30:57.057ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8252025-01-16T23:30:57.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8262025-01-16T23:30:57.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8272025-01-16T23:30:57.058ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8282025-01-16T23:30:57.058ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.596465ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8292025-01-16T23:30:57.059ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8302025-01-16T23:30:57.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.597335ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8312025-01-16T23:30:57.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.424482ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
8322025-01-16T23:30:57.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8332025-01-16T23:30:57.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.412209ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
8342025-01-16T23:30:57.065ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8352025-01-16T23:30:57.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8362025-01-16T23:30:57.066ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8372025-01-16T23:30:57.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8382025-01-16T23:30:57.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8392025-01-16T23:30:57.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8402025-01-16T23:30:57.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8412025-01-16T23:30:57.069ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
8422025-01-16T23:30:57.069ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8432025-01-16T23:30:57.070ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4586495-2017-4c54-92d1-7d7c43f4d3b4", "content-length": "26", "date": "Thu, 16 Jan 2025 23:30:57 GMT"} })
8442025-01-16T23:30:57.070ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8452025-01-16T23:30:57.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
8462025-01-16T23:30:57.071ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8472025-01-16T23:30:57.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8482025-01-16T23:30:57.072ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8492025-01-16T23:30:57.076ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 76.850176ms iteration = 14 status = 0
8502025-01-16T23:30:57.077ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
8512025-01-16T23:30:57.077ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.379776ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
8522025-01-16T23:30:57.084ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8532025-01-16T23:30:57.084ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
8542025-01-16T23:30:57.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8552025-01-16T23:30:57.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8562025-01-16T23:30:57.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 84.982052ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8572025-01-16T23:30:57.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 72252731-61d2-4f6e-b41c-667836d4cdc2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
8582025-01-16T23:30:57.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 72252731-61d2-4f6e-b41c-667836d4cdc2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
8592025-01-16T23:30:57.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 72252731-61d2-4f6e-b41c-667836d4cdc2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
8602025-01-16T23:30:57.095ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
8612025-01-16T23:30:57.095ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8622025-01-16T23:30:57.095ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db586f04-f7dc-48c6-9d35-3e717ef205b1", "content-length": "26", "date": "Thu, 16 Jan 2025 23:30:57 GMT"} })
8632025-01-16T23:30:57.095ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8642025-01-16T23:30:57.096ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
8652025-01-16T23:30:57.100ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8662025-01-16T23:30:57.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
8672025-01-16T23:30:57.102ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8682025-01-16T23:30:57.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8692025-01-16T23:30:57.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 104.590728ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
8702025-01-16T23:30:57.111ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8712025-01-16T23:30:57.111ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
8722025-01-16T23:30:57.111ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 111.904659ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
8732025-01-16T23:30:57.134ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
8742025-01-16T23:30:57.134ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 135.023633ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
8752025-01-16T23:30:57.148ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8762025-01-16T23:30:57.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8772025-01-16T23:30:57.160ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 160.561604ms iteration = 16 status = {"physical_disks_added":0}
8782025-01-16T23:30:57.163ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 163.240395ms iteration = 14 status = {}
8792025-01-16T23:30:57.169ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
8802025-01-16T23:30:57.169ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "105e464c-e670-4e82-bc9c-9c418eae03ba", "content-length": "1", "date": "Thu, 16 Jan 2025 23:30:56 GMT"} })
8812025-01-16T23:30:57.170ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8822025-01-16T23:30:57.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8832025-01-16T23:30:57.172ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 172.644946ms iteration = 14 status = null
8842025-01-16T23:30:57.185ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
8852025-01-16T23:30:57.185ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8862025-01-16T23:30:57.186ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a474bca3-0bfc-4289-99b1-dc9b36d48aaf", "content-length": "372", "date": "Thu, 16 Jan 2025 23:30:56 GMT"} })
8872025-01-16T23:30:57.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8882025-01-16T23:30:57.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8892025-01-16T23:30:57.206ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
8902025-01-16T23:30:57.206ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8912025-01-16T23:30:57.207ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d7c98bee-1fc8-4224-9c7d-60ee4fc1a18b", "date": "Thu, 16 Jan 2025 23:30:56 GMT"} })
8922025-01-16T23:30:57.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8932025-01-16T23:30:57.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8942025-01-16T23:30:57.210ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8952025-01-16T23:30:57.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8962025-01-16T23:30:57.212ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8972025-01-16T23:30:57.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8982025-01-16T23:30:57.216ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8992025-01-16T23:30:57.216ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
9002025-01-16T23:30:57.216ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9012025-01-16T23:30:57.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9022025-01-16T23:30:57.216ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "451bde80-db84-4c3b-a671-17154c04f933", "date": "Thu, 16 Jan 2025 23:30:56 GMT"} })
9032025-01-16T23:30:57.218ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9042025-01-16T23:30:57.218ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 218.624849ms iteration = 14 status = {}
9052025-01-16T23:30:57.220ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9062025-01-16T23:30:57.220ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9072025-01-16T23:30:57.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9082025-01-16T23:30:57.221ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9092025-01-16T23:30:57.223ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9102025-01-16T23:30:57.223ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9112025-01-16T23:30:57.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9122025-01-16T23:30:57.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9132025-01-16T23:30:57.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9142025-01-16T23:30:57.277ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
9152025-01-16T23:30:57.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9162025-01-16T23:30:57.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9172025-01-16T23:30:57.282ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
9182025-01-16T23:30:57.285ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
9192025-01-16T23:30:57.285ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "29461a1c-9c16-4317-8f6a-96484536a520", "content-length": "134", "date": "Thu, 16 Jan 2025 23:30:56 GMT"} })
9202025-01-16T23:30:57.285ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
9212025-01-16T23:30:57.285ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
9222025-01-16T23:30:57.285ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
9232025-01-16T23:30:57.285ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
9242025-01-16T23:30:57.285ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9252025-01-16T23:30:57.285ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9262025-01-16T23:30:57.285ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9272025-01-16T23:30:57.285ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9282025-01-16T23:30:57.285ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9292025-01-16T23:30:57.285ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9302025-01-16T23:30:57.286ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
9312025-01-16T23:30:57.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9322025-01-16T23:30:57.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9332025-01-16T23:30:57.287ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
9342025-01-16T23:30:57.287ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4662e7c9-2e9d-422e-83b4-05ad31b68192", "content-length": "2", "date": "Thu, 16 Jan 2025 23:30:56 GMT"} })
9352025-01-16T23:30:57.287ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
9362025-01-16T23:30:57.287ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f45360d-e9ea-4378-8bd2-50cb77d86d99", "content-length": "52", "date": "Thu, 16 Jan 2025 23:30:56 GMT"} })
9372025-01-16T23:30:57.287ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
9382025-01-16T23:30:57.287ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9392025-01-16T23:30:57.374ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6a8f7b1-c678-47e6-a231-a7f3c6a9de9a", "content-length": "691", "date": "Thu, 16 Jan 2025 23:30:57 GMT"} })
9402025-01-16T23:30:57.374ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
9412025-01-16T23:30:57.374ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
9422025-01-16T23:30:57.374ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
9432025-01-16T23:30:57.375ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 375.720145ms iteration = 14 status = {}
9442025-01-16T23:30:57.452ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fa91ac58-ad41-4e08-89a4-4e43f8428781", "date": "Thu, 16 Jan 2025 23:30:56 GMT"} })
9452025-01-16T23:30:57.452ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
9462025-01-16T23:30:57.452ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9472025-01-16T23:30:57.453ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8659cf41-40ce-4112-a487-cb08f5a625f8", "content-length": "682", "date": "Thu, 16 Jan 2025 23:30:57 GMT"} })
9482025-01-16T23:30:57.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9492025-01-16T23:30:57.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9502025-01-16T23:30:57.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9512025-01-16T23:30:57.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9522025-01-16T23:30:57.460ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9532025-01-16T23:30:57.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9542025-01-16T23:30:57.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9552025-01-16T23:30:57.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9562025-01-16T23:30:57.469ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 469.459886ms iteration = 14 status = {}
9572025-01-16T23:30:58.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4b47882e-0141-40eb-b3b3-70acf79d8355 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9582025-01-16T23:30:58.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4b47882e-0141-40eb-b3b3-70acf79d8355 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9592025-01-16T23:30:58.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4b47882e-0141-40eb-b3b3-70acf79d8355 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9602025-01-16T23:30:59.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b72fc495-d46e-4e27-8c9e-20a69408e5bd roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9612025-01-16T23:30:59.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b72fc495-d46e-4e27-8c9e-20a69408e5bd resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9622025-01-16T23:30:59.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b72fc495-d46e-4e27-8c9e-20a69408e5bd response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9632025-01-16T23:31:00.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 23cbccbf-0392-4975-b2e8-69e94e59f69f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9642025-01-16T23:31:00.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 23cbccbf-0392-4975-b2e8-69e94e59f69f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9652025-01-16T23:31:00.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 23cbccbf-0392-4975-b2e8-69e94e59f69f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9662025-01-16T23:31:01.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b3449762-3d2d-4f08-abdc-f68243b83789 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9672025-01-16T23:31:01.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b3449762-3d2d-4f08-abdc-f68243b83789 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9682025-01-16T23:31:01.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b3449762-3d2d-4f08-abdc-f68243b83789 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9692025-01-16T23:31:02.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 430a8794-116c-4f8b-a16d-401bb12335db roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9702025-01-16T23:31:02.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 430a8794-116c-4f8b-a16d-401bb12335db resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9712025-01-16T23:31:02.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 430a8794-116c-4f8b-a16d-401bb12335db response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9722025-01-16T23:31:03.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b2a18015-be27-4f76-8d97-64c9069b667a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9732025-01-16T23:31:03.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b2a18015-be27-4f76-8d97-64c9069b667a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9742025-01-16T23:31:03.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b2a18015-be27-4f76-8d97-64c9069b667a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9752025-01-16T23:31:04.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e01f858d-4242-4f2a-8184-98a47c109576 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9762025-01-16T23:31:04.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e01f858d-4242-4f2a-8184-98a47c109576 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9772025-01-16T23:31:04.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e01f858d-4242-4f2a-8184-98a47c109576 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9782025-01-16T23:31:05.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5f31e971-42d5-47f0-b4dd-0f171e1221e0 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9792025-01-16T23:31:05.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5f31e971-42d5-47f0-b4dd-0f171e1221e0 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9802025-01-16T23:31:05.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5f31e971-42d5-47f0-b4dd-0f171e1221e0 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9812025-01-16T23:31:05.730ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 559 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 7c59bcb3-48aa-4672-ad56-8f9bf72eee5a response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
9822025-01-16T23:31:06.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1dc348d4-419f-44fb-b064-7c56f5ed143e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9832025-01-16T23:31:06.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1dc348d4-419f-44fb-b064-7c56f5ed143e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9842025-01-16T23:31:06.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1dc348d4-419f-44fb-b064-7c56f5ed143e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
9852025-01-16T23:31:06.999ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
9862025-01-16T23:31:06.999ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9872025-01-16T23:31:06.999ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
9882025-01-16T23:31:06.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9892025-01-16T23:31:07.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9902025-01-16T23:31:07.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9912025-01-16T23:31:07.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9922025-01-16T23:31:07.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9932025-01-16T23:31:07.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9942025-01-16T23:31:07.003ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.709762ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9952025-01-16T23:31:07.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9962025-01-16T23:31:07.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9972025-01-16T23:31:07.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9982025-01-16T23:31:07.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9992025-01-16T23:31:07.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10002025-01-16T23:31:07.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10012025-01-16T23:31:07.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
10022025-01-16T23:31:07.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10032025-01-16T23:31:07.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10042025-01-16T23:31:07.019ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
10052025-01-16T23:31:07.019ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.692418ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
10062025-01-16T23:31:07.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e839a8c7-ccf9-4d8d-8c78-1f6d2bee7dc2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10072025-01-16T23:31:07.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e839a8c7-ccf9-4d8d-8c78-1f6d2bee7dc2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10082025-01-16T23:31:07.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e839a8c7-ccf9-4d8d-8c78-1f6d2bee7dc2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10092025-01-16T23:31:08.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8d89deaa-6d7e-47f4-b6b0-f2f0f1ae7611 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10102025-01-16T23:31:08.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8d89deaa-6d7e-47f4-b6b0-f2f0f1ae7611 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10112025-01-16T23:31:08.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8d89deaa-6d7e-47f4-b6b0-f2f0f1ae7611 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10122025-01-16T23:31:09.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d495005f-df29-4b42-bd4a-fdbee6dc9275 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10132025-01-16T23:31:09.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d495005f-df29-4b42-bd4a-fdbee6dc9275 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10142025-01-16T23:31:09.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d495005f-df29-4b42-bd4a-fdbee6dc9275 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10152025-01-16T23:31:10.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 964e542c-ffdd-4e72-a31e-19bce1ca9e04 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10162025-01-16T23:31:10.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 964e542c-ffdd-4e72-a31e-19bce1ca9e04 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10172025-01-16T23:31:10.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 964e542c-ffdd-4e72-a31e-19bce1ca9e04 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10182025-01-16T23:31:11.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a807c49b-3d56-4b21-82fa-141a8c0a6135 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10192025-01-16T23:31:11.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a807c49b-3d56-4b21-82fa-141a8c0a6135 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10202025-01-16T23:31:11.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2748 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a807c49b-3d56-4b21-82fa-141a8c0a6135 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10212025-01-16T23:31:12.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 26ba6cf8-239e-4c97-b16f-ab12ef9667f2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10222025-01-16T23:31:12.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 26ba6cf8-239e-4c97-b16f-ab12ef9667f2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10232025-01-16T23:31:12.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 26ba6cf8-239e-4c97-b16f-ab12ef9667f2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10242025-01-16T23:31:13.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 91da7377-3d45-4963-8c5b-6235ca400f1c roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10252025-01-16T23:31:13.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 91da7377-3d45-4963-8c5b-6235ca400f1c resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10262025-01-16T23:31:13.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 91da7377-3d45-4963-8c5b-6235ca400f1c response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10272025-01-16T23:31:14.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3be02fa2-439d-4c45-bae3-c3f7f8de7155 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10282025-01-16T23:31:14.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3be02fa2-439d-4c45-bae3-c3f7f8de7155 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10292025-01-16T23:31:14.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3be02fa2-439d-4c45-bae3-c3f7f8de7155 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10302025-01-16T23:31:15.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b5349ae3-0c24-48dd-8d3a-16a68f5db771 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10312025-01-16T23:31:15.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b5349ae3-0c24-48dd-8d3a-16a68f5db771 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10322025-01-16T23:31:15.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b5349ae3-0c24-48dd-8d3a-16a68f5db771 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10332025-01-16T23:31:15.730ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 481 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = cdf3522f-1d41-48b8-b9c0-e35e4f051201 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
10342025-01-16T23:31:16.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9ac4f6eb-9ceb-4d01-8f54-da78a1be29ec roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10352025-01-16T23:31:16.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9ac4f6eb-9ceb-4d01-8f54-da78a1be29ec resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10362025-01-16T23:31:16.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9ac4f6eb-9ceb-4d01-8f54-da78a1be29ec response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10372025-01-16T23:31:16.999ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
10382025-01-16T23:31:16.999ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
10392025-01-16T23:31:16.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10402025-01-16T23:31:16.999ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10412025-01-16T23:31:16.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10422025-01-16T23:31:16.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10432025-01-16T23:31:17.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10442025-01-16T23:31:17.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10452025-01-16T23:31:17.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10462025-01-16T23:31:17.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10472025-01-16T23:31:17.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10482025-01-16T23:31:17.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10492025-01-16T23:31:17.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10502025-01-16T23:31:17.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10512025-01-16T23:31:17.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10522025-01-16T23:31:17.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
10532025-01-16T23:31:17.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10542025-01-16T23:31:17.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10552025-01-16T23:31:17.022ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
10562025-01-16T23:31:17.022ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.685306ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
10572025-01-16T23:31:17.030ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.2313ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10582025-01-16T23:31:17.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4b73d447-8305-48df-b3af-e989243abf88 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10592025-01-16T23:31:17.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4b73d447-8305-48df-b3af-e989243abf88 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10602025-01-16T23:31:17.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4b73d447-8305-48df-b3af-e989243abf88 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10612025-01-16T23:31:18.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b7b7ffa1-9a34-4d47-b59d-f67c97326994 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10622025-01-16T23:31:18.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b7b7ffa1-9a34-4d47-b59d-f67c97326994 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10632025-01-16T23:31:18.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b7b7ffa1-9a34-4d47-b59d-f67c97326994 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10642025-01-16T23:31:19.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 05949b4c-7c5e-490a-bc83-98e12e1954ba roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10652025-01-16T23:31:19.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 05949b4c-7c5e-490a-bc83-98e12e1954ba resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10662025-01-16T23:31:19.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 05949b4c-7c5e-490a-bc83-98e12e1954ba response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10672025-01-16T23:31:20.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ca225e47-8ac7-4b82-8b6f-dc24d96d5814 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10682025-01-16T23:31:20.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ca225e47-8ac7-4b82-8b6f-dc24d96d5814 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10692025-01-16T23:31:20.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2749 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ca225e47-8ac7-4b82-8b6f-dc24d96d5814 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10702025-01-16T23:31:20.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 424735ff-16b3-4125-9960-5ddb62f416fe roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
10712025-01-16T23:31:20.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 424735ff-16b3-4125-9960-5ddb62f416fe resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
10722025-01-16T23:31:20.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 424735ff-16b3-4125-9960-5ddb62f416fe response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
10732025-01-16T23:31:20.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 94b2e404-784e-45a4-ae72-bdc42a3da66d roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
10742025-01-16T23:31:20.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 94b2e404-784e-45a4-ae72-bdc42a3da66d resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
10752025-01-16T23:31:20.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 94b2e404-784e-45a4-ae72-bdc42a3da66d response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
10762025-01-16T23:31:21.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9533c8ff-036e-4fcb-9944-578409ff4ce2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10772025-01-16T23:31:21.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9533c8ff-036e-4fcb-9944-578409ff4ce2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10782025-01-16T23:31:21.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9533c8ff-036e-4fcb-9944-578409ff4ce2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10792025-01-16T23:31:22.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 43e6bd24-e398-4539-8325-a820bcb8df42 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10802025-01-16T23:31:22.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 43e6bd24-e398-4539-8325-a820bcb8df42 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10812025-01-16T23:31:22.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 43e6bd24-e398-4539-8325-a820bcb8df42 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10822025-01-16T23:31:23.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dabe060a-732f-49ff-a903-4576a4269aac roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10832025-01-16T23:31:23.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dabe060a-732f-49ff-a903-4576a4269aac resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10842025-01-16T23:31:23.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1776 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dabe060a-732f-49ff-a903-4576a4269aac response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10852025-01-16T23:31:24.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 997e5f05-be03-409e-ad40-bb3ded0ff8b7 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10862025-01-16T23:31:24.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 997e5f05-be03-409e-ad40-bb3ded0ff8b7 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10872025-01-16T23:31:24.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 997e5f05-be03-409e-ad40-bb3ded0ff8b7 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10882025-01-16T23:31:25.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7ad1db4c-b9d8-4940-8c17-6caeab96dfa3 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10892025-01-16T23:31:25.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7ad1db4c-b9d8-4940-8c17-6caeab96dfa3 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10902025-01-16T23:31:25.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7ad1db4c-b9d8-4940-8c17-6caeab96dfa3 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10912025-01-16T23:31:25.730ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 548 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 11fea7cc-1f64-4956-a6ab-5f76afa6c18b response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
10922025-01-16T23:31:26.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 70d55d50-444f-48e8-b99e-5ecb23986d62 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10932025-01-16T23:31:26.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 70d55d50-444f-48e8-b99e-5ecb23986d62 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10942025-01-16T23:31:26.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 70d55d50-444f-48e8-b99e-5ecb23986d62 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
10952025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
10962025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10972025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
10982025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10992025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
11002025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
11012025-01-16T23:31:27.000ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
11022025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
11032025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
11042025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11052025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
11062025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11072025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
11082025-01-16T23:31:27.000ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
11092025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
11102025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11112025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11122025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
11132025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
11142025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
11152025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
11162025-01-16T23:31:27.000ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca
11172025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
11182025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.65\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca"}
11192025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
11202025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
11212025-01-16T23:31:27.000ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-16 23:21:27.000236095 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
11222025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11232025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11242025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
11252025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
11262025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11272025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
11282025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
11292025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
11302025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11312025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
11322025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
11332025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
11342025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11352025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
11362025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11372025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
11382025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
11392025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11402025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
11412025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11422025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
11432025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
11442025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11452025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11462025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
11472025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
11482025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
11492025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
11502025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
11512025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
11522025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11532025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
11542025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11552025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
11562025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
11572025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
11582025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
11592025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11602025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11612025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11622025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11632025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11642025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11652025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11662025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
11672025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11682025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11692025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11702025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11712025-01-16T23:31:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11722025-01-16T23:31:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11732025-01-16T23:31:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11742025-01-16T23:31:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
11752025-01-16T23:31:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11762025-01-16T23:31:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
11772025-01-16T23:31:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
11782025-01-16T23:31:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11792025-01-16T23:31:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11802025-01-16T23:31:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11812025-01-16T23:31:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11822025-01-16T23:31:27.001ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5c1ab32c-50b8-4564-bf29-e388b915cbdb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd10c057-8c9f-4db2-98b5-bcf5e0d536ba.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 318094953 } })
11832025-01-16T23:31:27.001ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dc5f3810-93b6-44f1-815c-44411abf99ad.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 318107624 } })
11842025-01-16T23:31:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
11852025-01-16T23:31:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
11862025-01-16T23:31:27.001ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
11872025-01-16T23:31:27.001ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.150402ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
11882025-01-16T23:31:27.001ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
11892025-01-16T23:31:27.001ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.55905ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
11902025-01-16T23:31:27.003ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 320682553 } })
11912025-01-16T23:31:27.003ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
11922025-01-16T23:31:27.004ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11932025-01-16T23:31:27.004ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11942025-01-16T23:31:27.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11952025-01-16T23:31:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11962025-01-16T23:31:27.005ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11972025-01-16T23:31:27.005ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.099308ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11982025-01-16T23:31:27.005ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11992025-01-16T23:31:27.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12002025-01-16T23:31:27.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12012025-01-16T23:31:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12022025-01-16T23:31:27.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12032025-01-16T23:31:27.006ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12042025-01-16T23:31:27.007ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12052025-01-16T23:31:27.007ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12062025-01-16T23:31:27.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12072025-01-16T23:31:27.008ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12082025-01-16T23:31:27.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12092025-01-16T23:31:27.008ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-16 23:21:27.000236095 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
12102025-01-16T23:31:27.008ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.273329ms iteration = 8 status = {"expiration":"2025-01-16T23:21:27.000236095Z","pruned":[]}
12112025-01-16T23:31:27.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12122025-01-16T23:31:27.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
12132025-01-16T23:31:27.009ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
12142025-01-16T23:31:27.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
12152025-01-16T23:31:27.010ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12162025-01-16T23:31:27.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12172025-01-16T23:31:27.011ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 328281229 } })
12182025-01-16T23:31:27.011ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
12192025-01-16T23:31:27.011ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12202025-01-16T23:31:27.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
12212025-01-16T23:31:27.013ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12222025-01-16T23:31:27.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12232025-01-16T23:31:27.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12242025-01-16T23:31:27.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12252025-01-16T23:31:27.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
12262025-01-16T23:31:27.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12272025-01-16T23:31:27.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12282025-01-16T23:31:27.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12292025-01-16T23:31:27.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12302025-01-16T23:31:27.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12312025-01-16T23:31:27.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12322025-01-16T23:31:27.017ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12332025-01-16T23:31:27.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12342025-01-16T23:31:27.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12352025-01-16T23:31:27.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12362025-01-16T23:31:27.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
12372025-01-16T23:31:27.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12382025-01-16T23:31:27.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12392025-01-16T23:31:27.022ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12402025-01-16T23:31:27.022ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12412025-01-16T23:31:27.024ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12422025-01-16T23:31:27.024ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.680845ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
12432025-01-16T23:31:27.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12442025-01-16T23:31:27.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12452025-01-16T23:31:27.024ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12462025-01-16T23:31:27.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12472025-01-16T23:31:27.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
12482025-01-16T23:31:27.025ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12492025-01-16T23:31:27.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12502025-01-16T23:31:27.027ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12512025-01-16T23:31:27.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12522025-01-16T23:31:27.028ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.720011ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12532025-01-16T23:31:27.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12542025-01-16T23:31:27.029ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12552025-01-16T23:31:27.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12562025-01-16T23:31:27.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12572025-01-16T23:31:27.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12582025-01-16T23:31:27.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12592025-01-16T23:31:27.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12602025-01-16T23:31:27.032ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12612025-01-16T23:31:27.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12622025-01-16T23:31:27.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12632025-01-16T23:31:27.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12642025-01-16T23:31:27.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 354944361 } })
12652025-01-16T23:31:27.038ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
12662025-01-16T23:31:27.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12672025-01-16T23:31:27.045ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12682025-01-16T23:31:27.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12692025-01-16T23:31:27.046ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 45.997173ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12702025-01-16T23:31:27.046ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12712025-01-16T23:31:27.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12722025-01-16T23:31:27.048ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12732025-01-16T23:31:27.049ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12742025-01-16T23:31:27.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12752025-01-16T23:31:27.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12762025-01-16T23:31:27.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
12772025-01-16T23:31:27.051ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12782025-01-16T23:31:27.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12792025-01-16T23:31:27.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12802025-01-16T23:31:27.052ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12812025-01-16T23:31:27.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12822025-01-16T23:31:27.055ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12832025-01-16T23:31:27.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12842025-01-16T23:31:27.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12852025-01-16T23:31:27.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12862025-01-16T23:31:27.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12872025-01-16T23:31:27.071ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12882025-01-16T23:31:27.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12892025-01-16T23:31:27.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12902025-01-16T23:31:27.077ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.53027ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
12912025-01-16T23:31:27.077ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12922025-01-16T23:31:27.077ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12932025-01-16T23:31:27.077ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12942025-01-16T23:31:27.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12952025-01-16T23:31:27.080ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12962025-01-16T23:31:27.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12972025-01-16T23:31:27.083ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
12982025-01-16T23:31:27.083ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
12992025-01-16T23:31:27.083ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 82.579366ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
13002025-01-16T23:31:27.084ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13012025-01-16T23:31:27.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13022025-01-16T23:31:27.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 91.278953ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
13032025-01-16T23:31:27.092ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
13042025-01-16T23:31:27.092ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
13052025-01-16T23:31:27.092ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
13062025-01-16T23:31:27.092ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13072025-01-16T23:31:27.092ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
13082025-01-16T23:31:27.092ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
13092025-01-16T23:31:27.092ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 92.426675ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
13102025-01-16T23:31:27.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13112025-01-16T23:31:27.094ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 94.474785ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
13122025-01-16T23:31:27.095ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
13132025-01-16T23:31:27.095ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
13142025-01-16T23:31:27.095ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
13152025-01-16T23:31:27.095ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13162025-01-16T23:31:27.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13172025-01-16T23:31:27.096ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
13182025-01-16T23:31:27.096ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 95.942933ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
13192025-01-16T23:31:27.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13202025-01-16T23:31:27.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13212025-01-16T23:31:27.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13222025-01-16T23:31:27.114ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13232025-01-16T23:31:27.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13242025-01-16T23:31:27.117ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
13252025-01-16T23:31:27.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
13262025-01-16T23:31:27.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
13272025-01-16T23:31:27.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13282025-01-16T23:31:27.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13292025-01-16T23:31:27.121ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 120.620687ms iteration = 17 status = {"physical_disks_added":0}
13302025-01-16T23:31:27.143ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
13312025-01-16T23:31:27.155ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
13322025-01-16T23:31:27.155ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13332025-01-16T23:31:27.155ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfeb1820-da05-48b7-922f-58f750241362", "content-length": "26", "date": "Thu, 16 Jan 2025 23:31:27 GMT"} })
13342025-01-16T23:31:27.155ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13352025-01-16T23:31:27.157ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13362025-01-16T23:31:27.196ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
13372025-01-16T23:31:27.196ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13382025-01-16T23:31:27.196ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "94485cd4-c57a-4d48-bf52-c27b59a48596", "content-length": "26", "date": "Thu, 16 Jan 2025 23:31:27 GMT"} })
13392025-01-16T23:31:27.196ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13402025-01-16T23:31:27.199ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13412025-01-16T23:31:27.199ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
13422025-01-16T23:31:27.244ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
13432025-01-16T23:31:27.244ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13442025-01-16T23:31:27.245ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9d389a0-d8e2-430d-a5e1-e70c0cd84c1a", "content-length": "26", "date": "Thu, 16 Jan 2025 23:31:27 GMT"} })
13452025-01-16T23:31:27.245ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13462025-01-16T23:31:27.246ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
13472025-01-16T23:31:27.321ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
13482025-01-16T23:31:27.321ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e15473e-c796-4823-8146-18af47a93536", "content-length": "691", "date": "Thu, 16 Jan 2025 23:31:27 GMT"} })
13492025-01-16T23:31:27.321ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
13502025-01-16T23:31:27.321ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
13512025-01-16T23:31:27.321ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
13522025-01-16T23:31:27.323ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 323.256748ms iteration = 15 status = {}
13532025-01-16T23:31:27.380ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 380.552589ms iteration = 15 status = {}
13542025-01-16T23:31:27.387ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
13552025-01-16T23:31:27.388ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a4733107-db07-46c3-aff0-d10f231fb2d0", "date": "Thu, 16 Jan 2025 23:31:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13562025-01-16T23:31:27.388ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13572025-01-16T23:31:27.390ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "24aeb94b-11ff-4f73-9581-acb75d42ae41", "date": "Thu, 16 Jan 2025 23:31:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13582025-01-16T23:31:27.390ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13592025-01-16T23:31:27.393ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13602025-01-16T23:31:27.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 393.479217ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
13612025-01-16T23:31:27.404ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
13622025-01-16T23:31:27.404ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13632025-01-16T23:31:27.407ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13642025-01-16T23:31:27.408ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13652025-01-16T23:31:27.408ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bddb4438-2031-418c-829f-f6ae4b1f65c9", "content-length": "1", "date": "Thu, 16 Jan 2025 23:31:26 GMT"} })
13662025-01-16T23:31:27.408ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13672025-01-16T23:31:27.408ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13682025-01-16T23:31:27.409ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13692025-01-16T23:31:27.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13702025-01-16T23:31:27.410ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13712025-01-16T23:31:27.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13722025-01-16T23:31:27.411ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
13732025-01-16T23:31:27.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
13742025-01-16T23:31:27.411ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13752025-01-16T23:31:27.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13762025-01-16T23:31:27.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13772025-01-16T23:31:27.413ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13782025-01-16T23:31:27.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13792025-01-16T23:31:27.413ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13802025-01-16T23:31:27.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13812025-01-16T23:31:27.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13822025-01-16T23:31:27.416ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13832025-01-16T23:31:27.417ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 416.805755ms iteration = 15 status = null
13842025-01-16T23:31:27.418ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
13852025-01-16T23:31:27.418ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 0 version = 2
13862025-01-16T23:31:27.418ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13872025-01-16T23:31:27.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13882025-01-16T23:31:27.419ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13892025-01-16T23:31:27.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
13902025-01-16T23:31:27.421ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13912025-01-16T23:31:27.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13922025-01-16T23:31:27.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13932025-01-16T23:31:27.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13942025-01-16T23:31:27.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13952025-01-16T23:31:27.430ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 429.984178ms iteration = 15 status = 0
13962025-01-16T23:31:27.430ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 1 version = 2
13972025-01-16T23:31:27.430ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
13982025-01-16T23:31:27.430ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-16 23:25:21.695734 UTC dns_group = external generation = 2
13992025-01-16T23:31:27.430ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 430.367086ms iteration = 8 status = {"generation":2}
14002025-01-16T23:31:27.431ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
14012025-01-16T23:31:27.431ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 431.065209ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
14022025-01-16T23:31:27.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 445.347563ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
14032025-01-16T23:31:27.452ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
14042025-01-16T23:31:27.452ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 452.590633ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
14052025-01-16T23:31:27.462ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
14062025-01-16T23:31:27.462ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
14072025-01-16T23:31:27.462ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14082025-01-16T23:31:27.462ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14092025-01-16T23:31:27.462ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14102025-01-16T23:31:27.462ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 462.85348ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
14112025-01-16T23:31:27.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14122025-01-16T23:31:27.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14132025-01-16T23:31:27.466ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14142025-01-16T23:31:27.468ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14152025-01-16T23:31:27.468ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14162025-01-16T23:31:27.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14172025-01-16T23:31:27.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14182025-01-16T23:31:27.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14192025-01-16T23:31:27.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14202025-01-16T23:31:27.473ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
14212025-01-16T23:31:27.473ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
14222025-01-16T23:31:27.473ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-16 23:25:20.756297 UTC dns_group = internal generation = 1
14232025-01-16T23:31:27.473ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 472.738029ms iteration = 8 status = {"generation":1}
14242025-01-16T23:31:27.483ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
14252025-01-16T23:31:27.484ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6028cdda-ba4c-42ed-9c9d-26892c8146c3", "date": "Thu, 16 Jan 2025 23:31:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14262025-01-16T23:31:27.484ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14272025-01-16T23:31:27.486ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d475dc08-dc6d-420e-acc8-6cd7e8594642", "date": "Thu, 16 Jan 2025 23:31:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14282025-01-16T23:31:27.486ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14292025-01-16T23:31:27.488ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "50701cd4-3008-4f0e-80a8-c4bded4bff22", "date": "Thu, 16 Jan 2025 23:31:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14302025-01-16T23:31:27.488ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14312025-01-16T23:31:27.490ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14322025-01-16T23:31:27.490ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 490.135944ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
14332025-01-16T23:31:27.503ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-16T23:24:20.471931Z, time_modified: 2025-01-16T23:24:20.471931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }) }
14342025-01-16T23:31:27.503ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 503.259205ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]}},"default_endpoint":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
14352025-01-16T23:31:27.515ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
14362025-01-16T23:31:27.515ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 515.033271ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
14372025-01-16T23:31:27.517ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e2bc94c-5711-4c7f-acc6-746163227e4c", "content-length": "372", "date": "Thu, 16 Jan 2025 23:31:27 GMT"} })
14382025-01-16T23:31:27.517ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14392025-01-16T23:31:27.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14402025-01-16T23:31:27.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14412025-01-16T23:31:27.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14422025-01-16T23:31:27.520ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
14432025-01-16T23:31:27.520ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14442025-01-16T23:31:27.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14452025-01-16T23:31:27.531ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
14462025-01-16T23:31:27.531ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9cb6586-34f9-4f14-bc45-5b92a8751bce", "content-length": "134", "date": "Thu, 16 Jan 2025 23:31:26 GMT"} })
14472025-01-16T23:31:27.531ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
14482025-01-16T23:31:27.531ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
14492025-01-16T23:31:27.532ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
14502025-01-16T23:31:27.532ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14512025-01-16T23:31:27.532ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14522025-01-16T23:31:27.532ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14532025-01-16T23:31:27.532ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14542025-01-16T23:31:27.532ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14552025-01-16T23:31:27.532ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14562025-01-16T23:31:27.532ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14572025-01-16T23:31:27.532ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
14582025-01-16T23:31:27.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14592025-01-16T23:31:27.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14602025-01-16T23:31:27.534ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
14612025-01-16T23:31:27.534ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ff6e588-7aa7-4b88-a11e-016158b1b537", "content-length": "2", "date": "Thu, 16 Jan 2025 23:31:26 GMT"} })
14622025-01-16T23:31:27.534ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
14632025-01-16T23:31:27.535ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a77e4040-cb1a-4eb0-be80-6e6665277e93", "content-length": "52", "date": "Thu, 16 Jan 2025 23:31:26 GMT"} })
14642025-01-16T23:31:27.535ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
14652025-01-16T23:31:27.535ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14662025-01-16T23:31:27.562ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
14672025-01-16T23:31:27.562ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
14682025-01-16T23:31:27.636ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ad242ccf-1f52-4c01-91d6-235c51ac1bc4", "date": "Thu, 16 Jan 2025 23:31:27 GMT"} })
14692025-01-16T23:31:27.636ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
14702025-01-16T23:31:27.636ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14712025-01-16T23:31:27.636ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5a12d1b6-007c-4b15-8279-49926081f605", "date": "Thu, 16 Jan 2025 23:31:27 GMT"} })
14722025-01-16T23:31:27.636ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14732025-01-16T23:31:27.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14742025-01-16T23:31:27.637ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c181819a-297e-4278-8d9d-9d1d907bdb0d", "content-length": "682", "date": "Thu, 16 Jan 2025 23:31:27 GMT"} })
14752025-01-16T23:31:27.637ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14762025-01-16T23:31:27.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14772025-01-16T23:31:27.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14782025-01-16T23:31:27.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14792025-01-16T23:31:27.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14802025-01-16T23:31:27.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14812025-01-16T23:31:27.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14822025-01-16T23:31:27.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14832025-01-16T23:31:27.644ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14842025-01-16T23:31:27.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14852025-01-16T23:31:27.646ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
14862025-01-16T23:31:27.646ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14872025-01-16T23:31:27.646ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d65e3c4c-cdf1-488d-99eb-4e41645c3297", "date": "Thu, 16 Jan 2025 23:31:27 GMT"} })
14882025-01-16T23:31:27.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14892025-01-16T23:31:27.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14902025-01-16T23:31:27.647ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 647.69511ms iteration = 15 status = {}
14912025-01-16T23:31:27.653ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 653.111823ms iteration = 15 status = {}
14922025-01-16T23:31:27.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a814a9d5-78ee-416c-a2c3-15b5c3580841 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
14932025-01-16T23:31:27.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a814a9d5-78ee-416c-a2c3-15b5c3580841 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
14942025-01-16T23:31:27.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a814a9d5-78ee-416c-a2c3-15b5c3580841 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
14952025-01-16T23:31:28.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a32c0961-6118-40ff-ac91-f7009a92dd96 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
14962025-01-16T23:31:28.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a32c0961-6118-40ff-ac91-f7009a92dd96 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
14972025-01-16T23:31:28.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a32c0961-6118-40ff-ac91-f7009a92dd96 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
14982025-01-16T23:31:29.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = db36706d-0f41-4b56-a481-0f48aabb8f27 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
14992025-01-16T23:31:29.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = db36706d-0f41-4b56-a481-0f48aabb8f27 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15002025-01-16T23:31:29.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = db36706d-0f41-4b56-a481-0f48aabb8f27 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15012025-01-16T23:31:30.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4e8f1ec7-4df2-4d84-9548-6fa598f8a2c3 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15022025-01-16T23:31:30.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4e8f1ec7-4df2-4d84-9548-6fa598f8a2c3 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15032025-01-16T23:31:30.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4e8f1ec7-4df2-4d84-9548-6fa598f8a2c3 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15042025-01-16T23:31:31.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ad86c1ca-a829-42e0-8b16-37fb7d9bb76a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15052025-01-16T23:31:31.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ad86c1ca-a829-42e0-8b16-37fb7d9bb76a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15062025-01-16T23:31:31.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ad86c1ca-a829-42e0-8b16-37fb7d9bb76a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15072025-01-16T23:31:32.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6b209ce7-2ade-47a5-ba15-8e67c996c726 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15082025-01-16T23:31:32.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6b209ce7-2ade-47a5-ba15-8e67c996c726 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15092025-01-16T23:31:32.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6b209ce7-2ade-47a5-ba15-8e67c996c726 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15102025-01-16T23:31:33.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e4dce86a-822f-4506-bf91-a5a975b95aff roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15112025-01-16T23:31:33.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e4dce86a-822f-4506-bf91-a5a975b95aff resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15122025-01-16T23:31:33.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e4dce86a-822f-4506-bf91-a5a975b95aff response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15132025-01-16T23:31:34.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aebc10d9-9a95-4331-8932-b7f1de5a55ba roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15142025-01-16T23:31:34.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aebc10d9-9a95-4331-8932-b7f1de5a55ba resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15152025-01-16T23:31:34.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aebc10d9-9a95-4331-8932-b7f1de5a55ba response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15162025-01-16T23:31:35.731ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 513 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 56aaeea6-f773-4bb3-882e-dd183f7986a5 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
15172025-01-16T23:31:35.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 294e6c50-b5c6-4eea-af44-90a46c299408 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15182025-01-16T23:31:35.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 294e6c50-b5c6-4eea-af44-90a46c299408 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15192025-01-16T23:31:35.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 294e6c50-b5c6-4eea-af44-90a46c299408 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15202025-01-16T23:31:36.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7a8de15e-3395-477b-abec-3f984edead41 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15212025-01-16T23:31:36.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7a8de15e-3395-477b-abec-3f984edead41 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15222025-01-16T23:31:36.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7a8de15e-3395-477b-abec-3f984edead41 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15232025-01-16T23:31:36.999ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
15242025-01-16T23:31:36.999ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
15252025-01-16T23:31:36.999ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15262025-01-16T23:31:36.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15272025-01-16T23:31:36.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15282025-01-16T23:31:36.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15292025-01-16T23:31:37.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15302025-01-16T23:31:37.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15312025-01-16T23:31:37.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15322025-01-16T23:31:37.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15332025-01-16T23:31:37.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15342025-01-16T23:31:37.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15352025-01-16T23:31:37.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15362025-01-16T23:31:37.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
15372025-01-16T23:31:37.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15382025-01-16T23:31:37.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15392025-01-16T23:31:37.022ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
15402025-01-16T23:31:37.022ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.318387ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
15412025-01-16T23:31:37.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15422025-01-16T23:31:37.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15432025-01-16T23:31:37.056ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.578737ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15442025-01-16T23:31:37.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5971c2ba-c264-4c17-8f49-b716d2cbc60f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15452025-01-16T23:31:37.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5971c2ba-c264-4c17-8f49-b716d2cbc60f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15462025-01-16T23:31:37.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5971c2ba-c264-4c17-8f49-b716d2cbc60f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15472025-01-16T23:31:38.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 70e0b069-7c2d-4e2c-98ab-11c3308291c8 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15482025-01-16T23:31:38.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 70e0b069-7c2d-4e2c-98ab-11c3308291c8 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15492025-01-16T23:31:38.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 70e0b069-7c2d-4e2c-98ab-11c3308291c8 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15502025-01-16T23:31:40.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6a4cee4c-fdfc-45e6-99c9-bf0347c9b41d roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15512025-01-16T23:31:40.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6a4cee4c-fdfc-45e6-99c9-bf0347c9b41d resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15522025-01-16T23:31:40.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6a4cee4c-fdfc-45e6-99c9-bf0347c9b41d response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15532025-01-16T23:31:41.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2033e2ab-d55a-47cb-9f6a-3cc03ee5b6c9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15542025-01-16T23:31:41.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2033e2ab-d55a-47cb-9f6a-3cc03ee5b6c9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15552025-01-16T23:31:41.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2033e2ab-d55a-47cb-9f6a-3cc03ee5b6c9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15562025-01-16T23:31:42.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a0caeca6-a554-4db1-856a-e362f5bc15fc roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15572025-01-16T23:31:42.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a0caeca6-a554-4db1-856a-e362f5bc15fc resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15582025-01-16T23:31:42.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a0caeca6-a554-4db1-856a-e362f5bc15fc response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15592025-01-16T23:31:43.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cd062ee9-f20d-41ea-b7ad-6fe384e29d46 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15602025-01-16T23:31:43.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cd062ee9-f20d-41ea-b7ad-6fe384e29d46 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15612025-01-16T23:31:43.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cd062ee9-f20d-41ea-b7ad-6fe384e29d46 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15622025-01-16T23:31:44.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e8163d95-6dd7-4d27-b1ef-82bf93f8990c roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15632025-01-16T23:31:44.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e8163d95-6dd7-4d27-b1ef-82bf93f8990c resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15642025-01-16T23:31:44.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e8163d95-6dd7-4d27-b1ef-82bf93f8990c response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15652025-01-16T23:31:45.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 65483695-133f-4d51-9195-48b012198cbb roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15662025-01-16T23:31:45.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 65483695-133f-4d51-9195-48b012198cbb resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15672025-01-16T23:31:45.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 65483695-133f-4d51-9195-48b012198cbb response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15682025-01-16T23:31:45.731ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 503 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 2f9bf526-d5ab-4ffa-be0a-0c610843fcca response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
15692025-01-16T23:31:46.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3f4f6ca7-e7e3-4491-aaff-227d8ccff831 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15702025-01-16T23:31:46.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3f4f6ca7-e7e3-4491-aaff-227d8ccff831 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15712025-01-16T23:31:46.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3f4f6ca7-e7e3-4491-aaff-227d8ccff831 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15722025-01-16T23:31:46.999ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
15732025-01-16T23:31:46.999ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
15742025-01-16T23:31:46.999ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15752025-01-16T23:31:46.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15762025-01-16T23:31:47.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15772025-01-16T23:31:47.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15782025-01-16T23:31:47.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15792025-01-16T23:31:47.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15802025-01-16T23:31:47.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15812025-01-16T23:31:47.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15822025-01-16T23:31:47.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15832025-01-16T23:31:47.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15842025-01-16T23:31:47.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15852025-01-16T23:31:47.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15862025-01-16T23:31:47.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15872025-01-16T23:31:47.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
15882025-01-16T23:31:47.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15892025-01-16T23:31:47.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15902025-01-16T23:31:47.025ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
15912025-01-16T23:31:47.025ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.778805ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
15922025-01-16T23:31:47.033ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.943092ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15932025-01-16T23:31:47.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 604b0cd3-1003-4e30-8d1f-b6b41bc9d0e5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15942025-01-16T23:31:47.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 604b0cd3-1003-4e30-8d1f-b6b41bc9d0e5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15952025-01-16T23:31:47.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 604b0cd3-1003-4e30-8d1f-b6b41bc9d0e5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15962025-01-16T23:31:48.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e02b70fd-8e27-4fec-8450-5b0dd358a9fa roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15972025-01-16T23:31:48.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e02b70fd-8e27-4fec-8450-5b0dd358a9fa resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15982025-01-16T23:31:48.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e02b70fd-8e27-4fec-8450-5b0dd358a9fa response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
15992025-01-16T23:31:49.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2473d1d5-ace7-43e1-946b-c7afbc36eb02 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16002025-01-16T23:31:49.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2473d1d5-ace7-43e1-946b-c7afbc36eb02 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16012025-01-16T23:31:49.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2473d1d5-ace7-43e1-946b-c7afbc36eb02 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16022025-01-16T23:31:50.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3b067c0f-d0b6-47c5-86f8-6fcc872bd139 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16032025-01-16T23:31:50.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3b067c0f-d0b6-47c5-86f8-6fcc872bd139 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16042025-01-16T23:31:50.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3b067c0f-d0b6-47c5-86f8-6fcc872bd139 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16052025-01-16T23:31:50.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = d57e8d49-de11-4a2e-b46f-94cf3393d986 roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
16062025-01-16T23:31:50.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = d57e8d49-de11-4a2e-b46f-94cf3393d986 resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
16072025-01-16T23:31:50.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = d57e8d49-de11-4a2e-b46f-94cf3393d986 response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
16082025-01-16T23:31:50.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 80cc835f-bc37-430d-8f5c-14d9fe76da0c roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
16092025-01-16T23:31:50.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 80cc835f-bc37-430d-8f5c-14d9fe76da0c resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
16102025-01-16T23:31:50.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 80cc835f-bc37-430d-8f5c-14d9fe76da0c response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
16112025-01-16T23:31:51.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 45c72365-ca6d-4ee4-8261-47ea9c9a4389 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16122025-01-16T23:31:51.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 45c72365-ca6d-4ee4-8261-47ea9c9a4389 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16132025-01-16T23:31:51.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 45c72365-ca6d-4ee4-8261-47ea9c9a4389 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16142025-01-16T23:31:52.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 47a17467-95df-489c-9a16-bbac075bb973 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16152025-01-16T23:31:52.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 47a17467-95df-489c-9a16-bbac075bb973 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16162025-01-16T23:31:52.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 47a17467-95df-489c-9a16-bbac075bb973 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16172025-01-16T23:31:53.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c743c092-2103-4475-96f5-83649bb1f7f9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16182025-01-16T23:31:53.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c743c092-2103-4475-96f5-83649bb1f7f9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16192025-01-16T23:31:53.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c743c092-2103-4475-96f5-83649bb1f7f9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16202025-01-16T23:31:54.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 90a32d1a-58e6-446f-8214-1d62e8b72a1e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16212025-01-16T23:31:54.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 90a32d1a-58e6-446f-8214-1d62e8b72a1e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16222025-01-16T23:31:54.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 90a32d1a-58e6-446f-8214-1d62e8b72a1e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16232025-01-16T23:31:55.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 67827491-d551-4c83-826c-2bd7e6948c87 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16242025-01-16T23:31:55.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 67827491-d551-4c83-826c-2bd7e6948c87 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16252025-01-16T23:31:55.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 67827491-d551-4c83-826c-2bd7e6948c87 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16262025-01-16T23:31:55.730ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 530 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 9b9cb9f4-15f1-40a4-a4a9-5687d53cf86a response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
16272025-01-16T23:31:56.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f5b5e38c-f870-483f-8ba8-40aa9483e947 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16282025-01-16T23:31:56.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f5b5e38c-f870-483f-8ba8-40aa9483e947 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16292025-01-16T23:31:56.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f5b5e38c-f870-483f-8ba8-40aa9483e947 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
16302025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
16312025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
16322025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16332025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
16342025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16352025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16362025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
16372025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16382025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
16392025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16402025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
16412025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
16422025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
16432025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16442025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16452025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16462025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16472025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
16482025-01-16T23:31:57.000ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16492025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16502025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
16512025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
16522025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16532025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
16542025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16552025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16562025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
16572025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16582025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
16592025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16602025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16612025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16622025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16632025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16642025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16652025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16662025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16672025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16682025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16692025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16702025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16712025-01-16T23:31:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16722025-01-16T23:31:57.001ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
16732025-01-16T23:31:57.001ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
16742025-01-16T23:31:57.001ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
16752025-01-16T23:31:57.001ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16762025-01-16T23:31:57.001ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
16772025-01-16T23:31:57.001ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
16782025-01-16T23:31:57.001ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
16792025-01-16T23:31:57.001ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16802025-01-16T23:31:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16812025-01-16T23:31:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16822025-01-16T23:31:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16832025-01-16T23:31:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16842025-01-16T23:31:57.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16852025-01-16T23:31:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16862025-01-16T23:31:57.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16872025-01-16T23:31:57.003ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1425, tv_nsec: 320588981 } })
16882025-01-16T23:31:57.004ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
16892025-01-16T23:31:57.004ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.566548ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16902025-01-16T23:31:57.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16912025-01-16T23:31:57.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16922025-01-16T23:31:57.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16932025-01-16T23:31:57.007ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16942025-01-16T23:31:57.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16952025-01-16T23:31:57.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
16962025-01-16T23:31:57.010ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16972025-01-16T23:31:57.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16982025-01-16T23:31:57.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16992025-01-16T23:31:57.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17002025-01-16T23:31:57.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17012025-01-16T23:31:57.020ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1425, tv_nsec: 337237291 } })
17022025-01-16T23:31:57.020ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
17032025-01-16T23:31:57.027ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17042025-01-16T23:31:57.027ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.184072ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17052025-01-16T23:31:57.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17062025-01-16T23:31:57.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17072025-01-16T23:31:57.031ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1425, tv_nsec: 348049189 } })
17082025-01-16T23:31:57.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17092025-01-16T23:31:57.031ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
17102025-01-16T23:31:57.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17112025-01-16T23:31:57.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17122025-01-16T23:31:57.055ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17132025-01-16T23:31:57.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17142025-01-16T23:31:57.055ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17152025-01-16T23:31:57.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17162025-01-16T23:31:57.057ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17172025-01-16T23:31:57.057ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17182025-01-16T23:31:57.057ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17192025-01-16T23:31:57.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17202025-01-16T23:31:57.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17212025-01-16T23:31:57.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17222025-01-16T23:31:57.058ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.240659ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17232025-01-16T23:31:57.058ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17242025-01-16T23:31:57.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17252025-01-16T23:31:57.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17262025-01-16T23:31:57.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17272025-01-16T23:31:57.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17282025-01-16T23:31:57.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17292025-01-16T23:31:57.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
17302025-01-16T23:31:57.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17312025-01-16T23:31:57.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17322025-01-16T23:31:57.063ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17332025-01-16T23:31:57.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17342025-01-16T23:31:57.064ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17352025-01-16T23:31:57.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17362025-01-16T23:31:57.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17372025-01-16T23:31:57.069ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17382025-01-16T23:31:57.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17392025-01-16T23:31:57.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17402025-01-16T23:31:57.071ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17412025-01-16T23:31:57.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17422025-01-16T23:31:57.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17432025-01-16T23:31:57.071ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17442025-01-16T23:31:57.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17452025-01-16T23:31:57.072ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17462025-01-16T23:31:57.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17472025-01-16T23:31:57.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.35429ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
17482025-01-16T23:31:57.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.626234ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
17492025-01-16T23:31:57.075ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17502025-01-16T23:31:57.076ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
17512025-01-16T23:31:57.076ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.257064ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
17522025-01-16T23:31:57.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17532025-01-16T23:31:57.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
17542025-01-16T23:31:57.077ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17552025-01-16T23:31:57.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17562025-01-16T23:31:57.079ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.461507ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17572025-01-16T23:31:57.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
17582025-01-16T23:31:57.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17592025-01-16T23:31:57.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17602025-01-16T23:31:57.082ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 82.167528ms iteration = 18 status = {"physical_disks_added":0}
17612025-01-16T23:31:57.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17622025-01-16T23:31:57.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17632025-01-16T23:31:57.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17642025-01-16T23:31:57.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17652025-01-16T23:31:57.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17662025-01-16T23:31:57.091ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
17672025-01-16T23:31:57.091ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.828463ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
17682025-01-16T23:31:57.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
17692025-01-16T23:31:57.094ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17702025-01-16T23:31:57.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17712025-01-16T23:31:57.095ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 95.82969ms iteration = 16 status = 0
17722025-01-16T23:31:57.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17732025-01-16T23:31:57.098ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
17742025-01-16T23:31:57.098ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17752025-01-16T23:31:57.099ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50daf21e-0f96-44ea-9b0e-089b5018d070", "content-length": "26", "date": "Thu, 16 Jan 2025 23:31:56 GMT"} })
17762025-01-16T23:31:57.099ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17772025-01-16T23:31:57.099ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17782025-01-16T23:31:57.099ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17792025-01-16T23:31:57.099ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17802025-01-16T23:31:57.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17812025-01-16T23:31:57.100ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17822025-01-16T23:31:57.100ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17832025-01-16T23:31:57.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17842025-01-16T23:31:57.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17852025-01-16T23:31:57.103ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 102.485468ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
17862025-01-16T23:31:57.104ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
17872025-01-16T23:31:57.104ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17882025-01-16T23:31:57.105ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0630c83-ad68-4e5b-bbba-40f363f891a9", "content-length": "26", "date": "Thu, 16 Jan 2025 23:31:56 GMT"} })
17892025-01-16T23:31:57.105ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17902025-01-16T23:31:57.106ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17912025-01-16T23:31:57.107ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
17922025-01-16T23:31:57.107ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 107.443463ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
17932025-01-16T23:31:57.115ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17942025-01-16T23:31:57.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17952025-01-16T23:31:57.140ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17962025-01-16T23:31:57.140ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17972025-01-16T23:31:57.140ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.266524ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17982025-01-16T23:31:57.179ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
17992025-01-16T23:31:57.179ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18002025-01-16T23:31:57.179ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2e3782e-231e-4261-9a63-721ea6003f85", "content-length": "26", "date": "Thu, 16 Jan 2025 23:31:56 GMT"} })
18012025-01-16T23:31:57.179ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18022025-01-16T23:31:57.180ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
18032025-01-16T23:31:57.203ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
18042025-01-16T23:31:57.203ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18052025-01-16T23:31:57.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18062025-01-16T23:31:57.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18072025-01-16T23:31:57.207ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18082025-01-16T23:31:57.209ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18092025-01-16T23:31:57.209ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18102025-01-16T23:31:57.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18112025-01-16T23:31:57.211ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18122025-01-16T23:31:57.211ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
18132025-01-16T23:31:57.212ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "437196ec-61e0-480f-9873-57087e07ec77", "content-length": "1", "date": "Thu, 16 Jan 2025 23:31:56 GMT"} })
18142025-01-16T23:31:57.213ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18152025-01-16T23:31:57.213ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18162025-01-16T23:31:57.213ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18172025-01-16T23:31:57.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18182025-01-16T23:31:57.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18192025-01-16T23:31:57.214ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 214.285476ms iteration = 16 status = {}
18202025-01-16T23:31:57.215ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 215.384527ms iteration = 16 status = null
18212025-01-16T23:31:57.232ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "afaa69f9-1835-4565-b073-c8febe8a05ca", "content-length": "372", "date": "Thu, 16 Jan 2025 23:31:57 GMT"} })
18222025-01-16T23:31:57.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18232025-01-16T23:31:57.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18242025-01-16T23:31:57.258ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18252025-01-16T23:31:57.258ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d8d1e23-c8e5-472a-8a68-c26803b6c6b8", "content-length": "691", "date": "Thu, 16 Jan 2025 23:31:57 GMT"} })
18262025-01-16T23:31:57.258ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
18272025-01-16T23:31:57.258ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
18282025-01-16T23:31:57.258ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
18292025-01-16T23:31:57.259ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 259.691518ms iteration = 16 status = {}
18302025-01-16T23:31:57.279ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
18312025-01-16T23:31:57.279ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
18322025-01-16T23:31:57.279ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bc8a2371-cef4-4bc9-9171-8d75fa8471c2", "date": "Thu, 16 Jan 2025 23:31:57 GMT"} })
18332025-01-16T23:31:57.279ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18342025-01-16T23:31:57.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18352025-01-16T23:31:57.281ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18362025-01-16T23:31:57.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18372025-01-16T23:31:57.284ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18382025-01-16T23:31:57.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18392025-01-16T23:31:57.287ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
18402025-01-16T23:31:57.287ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18412025-01-16T23:31:57.288ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b4b743bc-c66d-4f38-b0f7-44306521d542", "date": "Thu, 16 Jan 2025 23:31:57 GMT"} })
18422025-01-16T23:31:57.289ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 289.264166ms iteration = 16 status = {}
18432025-01-16T23:31:57.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18442025-01-16T23:31:57.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18452025-01-16T23:31:57.309ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
18462025-01-16T23:31:57.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18472025-01-16T23:31:57.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18482025-01-16T23:31:57.318ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
18492025-01-16T23:31:57.318ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cb4ca85-138a-4458-b7eb-a167dca78a31", "content-length": "134", "date": "Thu, 16 Jan 2025 23:31:56 GMT"} })
18502025-01-16T23:31:57.318ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
18512025-01-16T23:31:57.318ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
18522025-01-16T23:31:57.318ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
18532025-01-16T23:31:57.318ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18542025-01-16T23:31:57.318ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18552025-01-16T23:31:57.318ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18562025-01-16T23:31:57.318ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18572025-01-16T23:31:57.318ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18582025-01-16T23:31:57.319ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18592025-01-16T23:31:57.319ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18602025-01-16T23:31:57.319ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
18612025-01-16T23:31:57.319ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18622025-01-16T23:31:57.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18632025-01-16T23:31:57.321ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18642025-01-16T23:31:57.321ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb95c47d-e0de-48c1-bdb9-1ec18f3b8413", "content-length": "2", "date": "Thu, 16 Jan 2025 23:31:56 GMT"} })
18652025-01-16T23:31:57.321ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18662025-01-16T23:31:57.321ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6517b380-a594-43f8-adde-af9947246319", "content-length": "52", "date": "Thu, 16 Jan 2025 23:31:56 GMT"} })
18672025-01-16T23:31:57.321ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
18682025-01-16T23:31:57.321ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18692025-01-16T23:31:57.407ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "57d385db-0a87-4f62-b32e-6f28b91f12e9", "date": "Thu, 16 Jan 2025 23:31:57 GMT"} })
18702025-01-16T23:31:57.407ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
18712025-01-16T23:31:57.407ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18722025-01-16T23:31:57.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5bcfc156-f38b-4e58-848c-33be35230c69 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18732025-01-16T23:31:57.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5bcfc156-f38b-4e58-848c-33be35230c69 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18742025-01-16T23:31:57.407ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c73fa51-a5c0-4957-997c-0892ad1547f7", "content-length": "682", "date": "Thu, 16 Jan 2025 23:31:57 GMT"} })
18752025-01-16T23:31:57.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18762025-01-16T23:31:57.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18772025-01-16T23:31:57.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5bcfc156-f38b-4e58-848c-33be35230c69 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18782025-01-16T23:31:57.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18792025-01-16T23:31:57.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18802025-01-16T23:31:57.415ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18812025-01-16T23:31:57.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18822025-01-16T23:31:57.417ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18832025-01-16T23:31:57.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18842025-01-16T23:31:57.424ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 424.131715ms iteration = 16 status = {}
18852025-01-16T23:31:58.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 12c81f1b-644a-4839-937d-d3a5c9dd14f0 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18862025-01-16T23:31:58.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 12c81f1b-644a-4839-937d-d3a5c9dd14f0 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18872025-01-16T23:31:58.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 12c81f1b-644a-4839-937d-d3a5c9dd14f0 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18882025-01-16T23:31:59.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 26fddf90-738d-4dd3-8b8a-3ce5ef4aa330 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18892025-01-16T23:31:59.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 26fddf90-738d-4dd3-8b8a-3ce5ef4aa330 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18902025-01-16T23:31:59.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 26fddf90-738d-4dd3-8b8a-3ce5ef4aa330 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18912025-01-16T23:32:00.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2e9d86e1-6343-4377-918a-5d286a3221bb roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18922025-01-16T23:32:00.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2e9d86e1-6343-4377-918a-5d286a3221bb resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18932025-01-16T23:32:00.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2e9d86e1-6343-4377-918a-5d286a3221bb response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18942025-01-16T23:32:01.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c1eec03e-edc9-4719-a990-1dc87ad355c3 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18952025-01-16T23:32:01.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c1eec03e-edc9-4719-a990-1dc87ad355c3 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18962025-01-16T23:32:01.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c1eec03e-edc9-4719-a990-1dc87ad355c3 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18972025-01-16T23:32:02.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0484f89c-3a48-45b7-85ed-6d1a9bd95b5d roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18982025-01-16T23:32:02.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0484f89c-3a48-45b7-85ed-6d1a9bd95b5d resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
18992025-01-16T23:32:02.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0484f89c-3a48-45b7-85ed-6d1a9bd95b5d response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19002025-01-16T23:32:03.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 32eaeb87-6e77-4ad8-ba1a-45050887c8ab roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19012025-01-16T23:32:03.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 32eaeb87-6e77-4ad8-ba1a-45050887c8ab resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19022025-01-16T23:32:03.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 32eaeb87-6e77-4ad8-ba1a-45050887c8ab response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19032025-01-16T23:32:04.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3647e31d-df0d-45c7-9d16-86977b61d96e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19042025-01-16T23:32:04.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3647e31d-df0d-45c7-9d16-86977b61d96e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19052025-01-16T23:32:04.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3647e31d-df0d-45c7-9d16-86977b61d96e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19062025-01-16T23:32:05.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 45f9f5bc-f157-485f-b91c-1c179e84734f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19072025-01-16T23:32:05.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 45f9f5bc-f157-485f-b91c-1c179e84734f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19082025-01-16T23:32:05.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 45f9f5bc-f157-485f-b91c-1c179e84734f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19092025-01-16T23:32:05.731ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 478 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = c59b6fae-4446-465e-a312-f6a54759caba response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
19102025-01-16T23:32:06.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 65a48be8-78c5-4858-b45e-67dfc6e5fef1 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19112025-01-16T23:32:06.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 65a48be8-78c5-4858-b45e-67dfc6e5fef1 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19122025-01-16T23:32:06.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 65a48be8-78c5-4858-b45e-67dfc6e5fef1 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19132025-01-16T23:32:07.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
19142025-01-16T23:32:07.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19152025-01-16T23:32:07.000ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
19162025-01-16T23:32:07.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19172025-01-16T23:32:07.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19182025-01-16T23:32:07.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19192025-01-16T23:32:07.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19202025-01-16T23:32:07.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19212025-01-16T23:32:07.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19222025-01-16T23:32:07.003ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.561998ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19232025-01-16T23:32:07.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19242025-01-16T23:32:07.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19252025-01-16T23:32:07.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19262025-01-16T23:32:07.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19272025-01-16T23:32:07.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19282025-01-16T23:32:07.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19292025-01-16T23:32:07.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
19302025-01-16T23:32:07.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19312025-01-16T23:32:07.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19322025-01-16T23:32:07.019ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
19332025-01-16T23:32:07.019ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.833992ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
19342025-01-16T23:32:07.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b870c867-10ad-4a77-8b16-03134f71aeb7 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19352025-01-16T23:32:07.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b870c867-10ad-4a77-8b16-03134f71aeb7 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19362025-01-16T23:32:07.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b870c867-10ad-4a77-8b16-03134f71aeb7 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19372025-01-16T23:32:08.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 88d2cc65-5677-444a-90c8-ec24fa33d26a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19382025-01-16T23:32:08.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 88d2cc65-5677-444a-90c8-ec24fa33d26a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19392025-01-16T23:32:08.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 88d2cc65-5677-444a-90c8-ec24fa33d26a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19402025-01-16T23:32:09.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0ed194df-c990-436a-aed1-31c41cc2f569 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19412025-01-16T23:32:09.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0ed194df-c990-436a-aed1-31c41cc2f569 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19422025-01-16T23:32:09.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0ed194df-c990-436a-aed1-31c41cc2f569 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19432025-01-16T23:32:10.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7442b93e-f078-47d6-9ef9-9c6bb7169471 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19442025-01-16T23:32:10.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7442b93e-f078-47d6-9ef9-9c6bb7169471 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19452025-01-16T23:32:10.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7442b93e-f078-47d6-9ef9-9c6bb7169471 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19462025-01-16T23:32:11.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cf43a904-037e-437f-ac91-2546f0c661a5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19472025-01-16T23:32:11.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cf43a904-037e-437f-ac91-2546f0c661a5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19482025-01-16T23:32:11.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cf43a904-037e-437f-ac91-2546f0c661a5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19492025-01-16T23:32:12.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6ca23e70-5338-47d7-84c8-814917cf7ae5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19502025-01-16T23:32:12.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6ca23e70-5338-47d7-84c8-814917cf7ae5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19512025-01-16T23:32:12.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6ca23e70-5338-47d7-84c8-814917cf7ae5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19522025-01-16T23:32:13.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 935fc279-2df6-4125-a8f1-8bc5fd4d73aa roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19532025-01-16T23:32:13.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 935fc279-2df6-4125-a8f1-8bc5fd4d73aa resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19542025-01-16T23:32:13.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 935fc279-2df6-4125-a8f1-8bc5fd4d73aa response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19552025-01-16T23:32:14.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 98564d54-18c2-4384-8d3d-dc6e8ea948cb roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19562025-01-16T23:32:14.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 98564d54-18c2-4384-8d3d-dc6e8ea948cb resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19572025-01-16T23:32:14.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 98564d54-18c2-4384-8d3d-dc6e8ea948cb response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19582025-01-16T23:32:15.731ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 562 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 3854b674-b604-49f3-a40a-c53484f9445d response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
19592025-01-16T23:32:15.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3b2ffd64-d66e-420d-840c-13de6afc7ebd roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19602025-01-16T23:32:15.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3b2ffd64-d66e-420d-840c-13de6afc7ebd resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19612025-01-16T23:32:15.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3b2ffd64-d66e-420d-840c-13de6afc7ebd response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19622025-01-16T23:32:16.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 501cf80e-0123-4749-8df9-ca24000fd3b3 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19632025-01-16T23:32:16.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 501cf80e-0123-4749-8df9-ca24000fd3b3 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19642025-01-16T23:32:16.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 501cf80e-0123-4749-8df9-ca24000fd3b3 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19652025-01-16T23:32:17.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
19662025-01-16T23:32:17.000ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
19672025-01-16T23:32:17.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19682025-01-16T23:32:17.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19692025-01-16T23:32:17.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19702025-01-16T23:32:17.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19712025-01-16T23:32:17.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19722025-01-16T23:32:17.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19732025-01-16T23:32:17.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19742025-01-16T23:32:17.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19752025-01-16T23:32:17.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19762025-01-16T23:32:17.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19772025-01-16T23:32:17.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19782025-01-16T23:32:17.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19792025-01-16T23:32:17.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19802025-01-16T23:32:17.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
19812025-01-16T23:32:17.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19822025-01-16T23:32:17.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19832025-01-16T23:32:17.022ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
19842025-01-16T23:32:17.022ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.086754ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
19852025-01-16T23:32:17.030ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.786942ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19862025-01-16T23:32:17.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cbd1f862-3462-42a5-9186-79ab6ba441c8 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19872025-01-16T23:32:17.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cbd1f862-3462-42a5-9186-79ab6ba441c8 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19882025-01-16T23:32:17.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2728 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cbd1f862-3462-42a5-9186-79ab6ba441c8 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19892025-01-16T23:32:18.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 943994ea-e850-4d10-bfca-f78b2e1a3b82 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19902025-01-16T23:32:18.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 943994ea-e850-4d10-bfca-f78b2e1a3b82 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19912025-01-16T23:32:18.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 943994ea-e850-4d10-bfca-f78b2e1a3b82 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19922025-01-16T23:32:19.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 12b408ca-40ac-445d-8f7c-ac273ac31d73 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19932025-01-16T23:32:19.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 12b408ca-40ac-445d-8f7c-ac273ac31d73 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19942025-01-16T23:32:19.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 12b408ca-40ac-445d-8f7c-ac273ac31d73 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19952025-01-16T23:32:20.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9891efb3-cf9f-4e66-945c-c7aabfbb9fdb roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19962025-01-16T23:32:20.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9891efb3-cf9f-4e66-945c-c7aabfbb9fdb resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19972025-01-16T23:32:20.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9891efb3-cf9f-4e66-945c-c7aabfbb9fdb response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19982025-01-16T23:32:21.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dcee7dc4-bf8a-46fc-925f-62a660b0366b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
19992025-01-16T23:32:21.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dcee7dc4-bf8a-46fc-925f-62a660b0366b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
20002025-01-16T23:32:21.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dcee7dc4-bf8a-46fc-925f-62a660b0366b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
20012025-01-16T23:32:22.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 56dcda56-f9e9-44de-a67c-c0cfc6bf99b4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
20022025-01-16T23:32:22.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 56dcda56-f9e9-44de-a67c-c0cfc6bf99b4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
20032025-01-16T23:32:22.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 56dcda56-f9e9-44de-a67c-c0cfc6bf99b4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
20042025-01-16T23:32:23.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 57f4e156-3740-4e7c-b147-e06b11c7bc0f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
20052025-01-16T23:32:23.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 57f4e156-3740-4e7c-b147-e06b11c7bc0f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
20062025-01-16T23:32:23.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 57f4e156-3740-4e7c-b147-e06b11c7bc0f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
20072025-01-16T23:32:24.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 89177c29-72ed-4e9a-801a-c4bd4c9bd8b5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
20082025-01-16T23:32:24.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 89177c29-72ed-4e9a-801a-c4bd4c9bd8b5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
20092025-01-16T23:32:25.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 89177c29-72ed-4e9a-801a-c4bd4c9bd8b5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
20102025-01-16T23:32:25.731ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 558 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 3ddfb750-0fff-4fe4-812b-c0ac9b72aa9c response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
20112025-01-16T23:32:26.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d147d839-d925-4220-89f9-40265cfaf9a7 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
20122025-01-16T23:32:26.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d147d839-d925-4220-89f9-40265cfaf9a7 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
20132025-01-16T23:32:26.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d147d839-d925-4220-89f9-40265cfaf9a7 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
20142025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
20152025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20162025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
20172025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
20182025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20192025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20202025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
20212025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20222025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
20232025-01-16T23:32:27.000ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
20242025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
20252025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20262025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
20272025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20282025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
20292025-01-16T23:32:27.000ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20302025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
20312025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20322025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
20332025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20342025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20352025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20362025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
20372025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
20382025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20392025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
20402025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20412025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
20422025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
20432025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20442025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
20452025-01-16T23:32:27.000ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-16 23:22:27.000327985 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
20462025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
20472025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
20482025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
20492025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20502025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
20512025-01-16T23:32:27.000ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca
20522025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
20532025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.11\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca"}
20542025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
20552025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
20562025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
20572025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20582025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
20592025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
20602025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20612025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
20622025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20632025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
20642025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20652025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
20662025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20672025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20682025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20692025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
20702025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20712025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20722025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20732025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20742025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
20752025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
20762025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
20772025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
20782025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20792025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
20802025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
20812025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20822025-01-16T23:32:27.000ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20832025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
20842025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20852025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
20862025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
20872025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20882025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20892025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
20902025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20912025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20922025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
20932025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20942025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20952025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20962025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
20972025-01-16T23:32:27.001ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5c1ab32c-50b8-4564-bf29-e388b915cbdb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd10c057-8c9f-4db2-98b5-bcf5e0d536ba.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 317471751 } })
20982025-01-16T23:32:27.001ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dc5f3810-93b6-44f1-815c-44411abf99ad.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 317478481 } })
20992025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21002025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21012025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
21022025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
21032025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
21042025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
21052025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
21062025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.018599ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
21072025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
21082025-01-16T23:32:27.001ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.249384ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
21092025-01-16T23:32:27.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21102025-01-16T23:32:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21112025-01-16T23:32:27.003ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21122025-01-16T23:32:27.004ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.987316ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
21132025-01-16T23:32:27.004ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 320932038 } })
21142025-01-16T23:32:27.004ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21152025-01-16T23:32:27.004ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
21162025-01-16T23:32:27.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21172025-01-16T23:32:27.005ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 322079630 } })
21182025-01-16T23:32:27.005ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
21192025-01-16T23:32:27.006ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21202025-01-16T23:32:27.006ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21212025-01-16T23:32:27.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21222025-01-16T23:32:27.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
21232025-01-16T23:32:27.007ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
21242025-01-16T23:32:27.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
21252025-01-16T23:32:27.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21262025-01-16T23:32:27.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
21272025-01-16T23:32:27.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21282025-01-16T23:32:27.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21292025-01-16T23:32:27.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21302025-01-16T23:32:27.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21312025-01-16T23:32:27.009ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21322025-01-16T23:32:27.010ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21332025-01-16T23:32:27.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21342025-01-16T23:32:27.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21352025-01-16T23:32:27.010ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21362025-01-16T23:32:27.010ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
21372025-01-16T23:32:27.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21382025-01-16T23:32:27.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21392025-01-16T23:32:27.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21402025-01-16T23:32:27.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
21412025-01-16T23:32:27.011ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21422025-01-16T23:32:27.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21432025-01-16T23:32:27.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21442025-01-16T23:32:27.011ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21452025-01-16T23:32:27.013ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21462025-01-16T23:32:27.013ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21472025-01-16T23:32:27.013ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-16 23:22:27.000327985 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
21482025-01-16T23:32:27.013ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.00639ms iteration = 9 status = {"expiration":"2025-01-16T23:22:27.000327985Z","pruned":[]}
21492025-01-16T23:32:27.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21502025-01-16T23:32:27.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21512025-01-16T23:32:27.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
21522025-01-16T23:32:27.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21532025-01-16T23:32:27.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21542025-01-16T23:32:27.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21552025-01-16T23:32:27.015ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21562025-01-16T23:32:27.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21572025-01-16T23:32:27.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21582025-01-16T23:32:27.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
21592025-01-16T23:32:27.016ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21602025-01-16T23:32:27.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21612025-01-16T23:32:27.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21622025-01-16T23:32:27.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21632025-01-16T23:32:27.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21642025-01-16T23:32:27.019ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 18.858242ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
21652025-01-16T23:32:27.023ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.758077ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
21662025-01-16T23:32:27.025ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.02188ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21672025-01-16T23:32:27.027ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21682025-01-16T23:32:27.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21692025-01-16T23:32:27.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21702025-01-16T23:32:27.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21712025-01-16T23:32:27.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21722025-01-16T23:32:27.031ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21732025-01-16T23:32:27.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21742025-01-16T23:32:27.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21752025-01-16T23:32:27.034ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
21762025-01-16T23:32:27.034ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
21772025-01-16T23:32:27.034ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 34.309979ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
21782025-01-16T23:32:27.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21792025-01-16T23:32:27.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21802025-01-16T23:32:27.035ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 351572156 } })
21812025-01-16T23:32:27.035ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
21822025-01-16T23:32:27.040ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21832025-01-16T23:32:27.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21842025-01-16T23:32:27.041ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21852025-01-16T23:32:27.041ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 41.171941ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21862025-01-16T23:32:27.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 97f85554-d4cf-4ccb-8875-f0d0a0f41906 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
21872025-01-16T23:32:27.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 97f85554-d4cf-4ccb-8875-f0d0a0f41906 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
21882025-01-16T23:32:27.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21892025-01-16T23:32:27.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21902025-01-16T23:32:27.044ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21912025-01-16T23:32:27.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21922025-01-16T23:32:27.046ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21932025-01-16T23:32:27.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 97f85554-d4cf-4ccb-8875-f0d0a0f41906 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
21942025-01-16T23:32:27.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
21952025-01-16T23:32:27.050ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21962025-01-16T23:32:27.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21972025-01-16T23:32:27.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21982025-01-16T23:32:27.052ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21992025-01-16T23:32:27.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
22002025-01-16T23:32:27.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22012025-01-16T23:32:27.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22022025-01-16T23:32:27.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22032025-01-16T23:32:27.055ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22042025-01-16T23:32:27.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22052025-01-16T23:32:27.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22062025-01-16T23:32:27.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22072025-01-16T23:32:27.070ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22082025-01-16T23:32:27.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22092025-01-16T23:32:27.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.165186ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
22102025-01-16T23:32:27.073ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22112025-01-16T23:32:27.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22122025-01-16T23:32:27.074ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.212966ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
22132025-01-16T23:32:27.076ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
22142025-01-16T23:32:27.076ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
22152025-01-16T23:32:27.076ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 75.064582ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
22162025-01-16T23:32:27.077ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
22172025-01-16T23:32:27.077ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.731574ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
22182025-01-16T23:32:27.081ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22192025-01-16T23:32:27.081ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22202025-01-16T23:32:27.081ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
22212025-01-16T23:32:27.081ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22222025-01-16T23:32:27.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22232025-01-16T23:32:27.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22242025-01-16T23:32:27.082ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22252025-01-16T23:32:27.083ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22262025-01-16T23:32:27.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22272025-01-16T23:32:27.084ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
22282025-01-16T23:32:27.084ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
22292025-01-16T23:32:27.084ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
22302025-01-16T23:32:27.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22312025-01-16T23:32:27.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22322025-01-16T23:32:27.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
22332025-01-16T23:32:27.086ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22342025-01-16T23:32:27.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22352025-01-16T23:32:27.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22362025-01-16T23:32:27.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22372025-01-16T23:32:27.088ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22382025-01-16T23:32:27.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
22392025-01-16T23:32:27.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22402025-01-16T23:32:27.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22412025-01-16T23:32:27.094ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 94.29114ms iteration = 17 status = 0
22422025-01-16T23:32:27.099ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
22432025-01-16T23:32:27.099ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
22442025-01-16T23:32:27.099ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
22452025-01-16T23:32:27.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22462025-01-16T23:32:27.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22472025-01-16T23:32:27.103ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22482025-01-16T23:32:27.106ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22492025-01-16T23:32:27.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22502025-01-16T23:32:27.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22512025-01-16T23:32:27.106ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22522025-01-16T23:32:27.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22532025-01-16T23:32:27.108ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22542025-01-16T23:32:27.110ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22552025-01-16T23:32:27.110ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22562025-01-16T23:32:27.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22572025-01-16T23:32:27.110ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 110.001762ms iteration = 19 status = {"physical_disks_added":0}
22582025-01-16T23:32:27.113ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22592025-01-16T23:32:27.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
22602025-01-16T23:32:27.120ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
22612025-01-16T23:32:27.120ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 120.403283ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
22622025-01-16T23:32:27.121ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22632025-01-16T23:32:27.121ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
22642025-01-16T23:32:27.121ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.574315ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
22652025-01-16T23:32:27.123ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 122.304859ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
22662025-01-16T23:32:27.123ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22672025-01-16T23:32:27.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22682025-01-16T23:32:27.127ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22692025-01-16T23:32:27.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22702025-01-16T23:32:27.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22712025-01-16T23:32:27.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22722025-01-16T23:32:27.132ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
22732025-01-16T23:32:27.150ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-16T23:24:20.471931Z, time_modified: 2025-01-16T23:24:20.471931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }) }
22742025-01-16T23:32:27.150ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 150.249476ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]}},"default_endpoint":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
22752025-01-16T23:32:27.151ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
22762025-01-16T23:32:27.151ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 0 version = 2
22772025-01-16T23:32:27.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22782025-01-16T23:32:27.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22792025-01-16T23:32:27.153ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22802025-01-16T23:32:27.156ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22812025-01-16T23:32:27.156ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22822025-01-16T23:32:27.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22832025-01-16T23:32:27.158ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 1 version = 2
22842025-01-16T23:32:27.158ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
22852025-01-16T23:32:27.158ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-16 23:25:21.695734 UTC dns_group = external generation = 2
22862025-01-16T23:32:27.158ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 158.012505ms iteration = 9 status = {"generation":2}
22872025-01-16T23:32:27.158ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
22882025-01-16T23:32:27.158ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22892025-01-16T23:32:27.158ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aed3357c-27d2-453c-a3b6-08acc851358b", "content-length": "26", "date": "Thu, 16 Jan 2025 23:32:26 GMT"} })
22902025-01-16T23:32:27.158ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22912025-01-16T23:32:27.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 159.158527ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
22922025-01-16T23:32:27.160ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22932025-01-16T23:32:27.163ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22942025-01-16T23:32:27.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22952025-01-16T23:32:27.165ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22962025-01-16T23:32:27.167ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22972025-01-16T23:32:27.167ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22982025-01-16T23:32:27.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22992025-01-16T23:32:27.168ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
23002025-01-16T23:32:27.168ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
23012025-01-16T23:32:27.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23022025-01-16T23:32:27.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23032025-01-16T23:32:27.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23042025-01-16T23:32:27.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23052025-01-16T23:32:27.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23062025-01-16T23:32:27.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23072025-01-16T23:32:27.198ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
23082025-01-16T23:32:27.198ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23092025-01-16T23:32:27.198ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d767ebb-31e9-4d57-aba2-f8b73648d38d", "content-length": "26", "date": "Thu, 16 Jan 2025 23:32:26 GMT"} })
23102025-01-16T23:32:27.198ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23112025-01-16T23:32:27.200ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
23122025-01-16T23:32:27.208ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23132025-01-16T23:32:27.210ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23142025-01-16T23:32:27.210ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23152025-01-16T23:32:27.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23162025-01-16T23:32:27.214ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
23172025-01-16T23:32:27.214ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 214.52441ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
23182025-01-16T23:32:27.294ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
23192025-01-16T23:32:27.318ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
23202025-01-16T23:32:27.318ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23212025-01-16T23:32:27.319ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cca57aa1-926c-4ef6-ba07-42705caa7ef5", "content-length": "26", "date": "Thu, 16 Jan 2025 23:32:26 GMT"} })
23222025-01-16T23:32:27.319ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23232025-01-16T23:32:27.321ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23242025-01-16T23:32:27.339ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 339.800447ms iteration = 17 status = {}
23252025-01-16T23:32:27.436ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
23262025-01-16T23:32:27.437ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23272025-01-16T23:32:27.439ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
23282025-01-16T23:32:27.439ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
23292025-01-16T23:32:27.439ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-16 23:25:20.756297 UTC dns_group = internal generation = 1
23302025-01-16T23:32:27.439ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 439.518901ms iteration = 9 status = {"generation":1}
23312025-01-16T23:32:27.442ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
23322025-01-16T23:32:27.442ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "894aea4b-ed93-40c7-9b6c-7196a88cb80e", "date": "Thu, 16 Jan 2025 23:32:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23332025-01-16T23:32:27.442ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23342025-01-16T23:32:27.444ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "18b715ad-9948-4fd5-a0cf-8ff7d3c764ca", "date": "Thu, 16 Jan 2025 23:32:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23352025-01-16T23:32:27.444ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23362025-01-16T23:32:27.446ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23372025-01-16T23:32:27.446ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 446.122908ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
23382025-01-16T23:32:27.448ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
23392025-01-16T23:32:27.457ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d22e3fe-2cb8-4d08-be74-67b9f5b2e9ed", "content-length": "372", "date": "Thu, 16 Jan 2025 23:32:27 GMT"} })
23402025-01-16T23:32:27.457ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23412025-01-16T23:32:27.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23422025-01-16T23:32:27.459ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
23432025-01-16T23:32:27.459ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "27ce0667-ee83-4ac0-9fe9-54c156851ff9", "content-length": "1", "date": "Thu, 16 Jan 2025 23:32:26 GMT"} })
23442025-01-16T23:32:27.461ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23452025-01-16T23:32:27.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23462025-01-16T23:32:27.463ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 463.153736ms iteration = 17 status = null
23472025-01-16T23:32:27.500ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
23482025-01-16T23:32:27.500ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
23492025-01-16T23:32:27.501ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "edd7e587-3a55-42d7-8803-2c2c75264c34", "date": "Thu, 16 Jan 2025 23:32:27 GMT"} })
23502025-01-16T23:32:27.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23512025-01-16T23:32:27.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23522025-01-16T23:32:27.503ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23532025-01-16T23:32:27.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23542025-01-16T23:32:27.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23552025-01-16T23:32:27.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23562025-01-16T23:32:27.509ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
23572025-01-16T23:32:27.509ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23582025-01-16T23:32:27.510ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dc789356-80fb-402d-a16e-c56415dc6199", "date": "Thu, 16 Jan 2025 23:32:27 GMT"} })
23592025-01-16T23:32:27.512ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 511.998724ms iteration = 17 status = {}
23602025-01-16T23:32:27.518ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
23612025-01-16T23:32:27.518ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6520e0dc-0d6c-4710-b93c-da769799b168", "date": "Thu, 16 Jan 2025 23:32:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23622025-01-16T23:32:27.518ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23632025-01-16T23:32:27.520ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7900d4cc-9c71-4283-86c8-fd56271f2abd", "date": "Thu, 16 Jan 2025 23:32:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23642025-01-16T23:32:27.520ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23652025-01-16T23:32:27.521ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "dfb1cf2f-b000-4b9f-b81d-e14d0cd1394e", "date": "Thu, 16 Jan 2025 23:32:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23662025-01-16T23:32:27.521ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23672025-01-16T23:32:27.523ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23682025-01-16T23:32:27.523ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 523.219329ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
23692025-01-16T23:32:27.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23702025-01-16T23:32:27.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23712025-01-16T23:32:27.557ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23722025-01-16T23:32:27.558ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d863ac1-8ffd-4bd0-b129-2fabfae6199f", "content-length": "691", "date": "Thu, 16 Jan 2025 23:32:27 GMT"} })
23732025-01-16T23:32:27.558ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
23742025-01-16T23:32:27.558ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
23752025-01-16T23:32:27.558ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
23762025-01-16T23:32:27.559ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
23772025-01-16T23:32:27.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23782025-01-16T23:32:27.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23792025-01-16T23:32:27.560ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 560.134978ms iteration = 17 status = {}
23802025-01-16T23:32:27.569ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
23812025-01-16T23:32:27.569ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0cb4577-02af-4eec-88a4-5541fca6062a", "content-length": "134", "date": "Thu, 16 Jan 2025 23:32:26 GMT"} })
23822025-01-16T23:32:27.569ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
23832025-01-16T23:32:27.569ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
23842025-01-16T23:32:27.569ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
23852025-01-16T23:32:27.569ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
23862025-01-16T23:32:27.569ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23872025-01-16T23:32:27.569ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23882025-01-16T23:32:27.570ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23892025-01-16T23:32:27.570ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
23902025-01-16T23:32:27.570ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23912025-01-16T23:32:27.570ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
23922025-01-16T23:32:27.570ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
23932025-01-16T23:32:27.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23942025-01-16T23:32:27.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23952025-01-16T23:32:27.572ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
23962025-01-16T23:32:27.572ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fba162d-335f-4b92-a403-16152bb9ef54", "content-length": "2", "date": "Thu, 16 Jan 2025 23:32:26 GMT"} })
23972025-01-16T23:32:27.572ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
23982025-01-16T23:32:27.572ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "22150afe-b328-4f65-9118-aafc7cb002f2", "content-length": "52", "date": "Thu, 16 Jan 2025 23:32:26 GMT"} })
23992025-01-16T23:32:27.572ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
24002025-01-16T23:32:27.572ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24012025-01-16T23:32:27.671ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c02e8bf3-492a-45c7-8ec8-ce6bd1302f22", "date": "Thu, 16 Jan 2025 23:32:27 GMT"} })
24022025-01-16T23:32:27.672ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
24032025-01-16T23:32:27.672ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24042025-01-16T23:32:27.674ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4471ba3e-8111-4c56-895a-dee3a21eacaf", "content-length": "682", "date": "Thu, 16 Jan 2025 23:32:27 GMT"} })
24052025-01-16T23:32:27.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24062025-01-16T23:32:27.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24072025-01-16T23:32:27.678ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24082025-01-16T23:32:27.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24092025-01-16T23:32:27.682ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24102025-01-16T23:32:27.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24112025-01-16T23:32:27.684ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24122025-01-16T23:32:27.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24132025-01-16T23:32:27.691ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 691.174674ms iteration = 17 status = {}
24142025-01-16T23:32:28.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 83b9bd08-a469-4c32-bbdf-7ff83a686121 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24152025-01-16T23:32:28.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 83b9bd08-a469-4c32-bbdf-7ff83a686121 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24162025-01-16T23:32:28.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 83b9bd08-a469-4c32-bbdf-7ff83a686121 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24172025-01-16T23:32:29.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1074791e-66d7-4dfc-861f-eea029d97252 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24182025-01-16T23:32:29.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1074791e-66d7-4dfc-861f-eea029d97252 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24192025-01-16T23:32:29.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1074791e-66d7-4dfc-861f-eea029d97252 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24202025-01-16T23:32:30.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 228ea67d-1fc2-4d89-b7de-d5d666d83d17 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24212025-01-16T23:32:30.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 228ea67d-1fc2-4d89-b7de-d5d666d83d17 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24222025-01-16T23:32:30.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 228ea67d-1fc2-4d89-b7de-d5d666d83d17 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24232025-01-16T23:32:31.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7cbf5c0b-5240-4cb0-8704-a2bba32a882e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24242025-01-16T23:32:31.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7cbf5c0b-5240-4cb0-8704-a2bba32a882e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24252025-01-16T23:32:31.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7cbf5c0b-5240-4cb0-8704-a2bba32a882e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24262025-01-16T23:32:32.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f4cf1b89-ed17-44bd-91cb-2ea366040955 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24272025-01-16T23:32:32.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f4cf1b89-ed17-44bd-91cb-2ea366040955 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24282025-01-16T23:32:32.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f4cf1b89-ed17-44bd-91cb-2ea366040955 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24292025-01-16T23:32:33.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e8cd4eeb-551e-46f4-be62-7d3c96d7d9ad roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24302025-01-16T23:32:33.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e8cd4eeb-551e-46f4-be62-7d3c96d7d9ad resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24312025-01-16T23:32:33.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e8cd4eeb-551e-46f4-be62-7d3c96d7d9ad response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24322025-01-16T23:32:34.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = da734d7f-02b1-48a0-b2ee-38a195b0d8fe roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24332025-01-16T23:32:34.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = da734d7f-02b1-48a0-b2ee-38a195b0d8fe resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24342025-01-16T23:32:34.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = da734d7f-02b1-48a0-b2ee-38a195b0d8fe response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24352025-01-16T23:32:35.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b21bfde6-2e0c-4f94-bfa1-bd83020a7258 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24362025-01-16T23:32:35.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b21bfde6-2e0c-4f94-bfa1-bd83020a7258 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24372025-01-16T23:32:35.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b21bfde6-2e0c-4f94-bfa1-bd83020a7258 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24382025-01-16T23:32:35.731ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 576 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = fb8cf6bf-882f-42d5-bb4a-993d861482fe response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
24392025-01-16T23:32:36.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b4d73b04-bd26-4933-bdec-9eb816b35fda roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24402025-01-16T23:32:36.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b4d73b04-bd26-4933-bdec-9eb816b35fda resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24412025-01-16T23:32:36.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b4d73b04-bd26-4933-bdec-9eb816b35fda response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24422025-01-16T23:32:37.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
24432025-01-16T23:32:37.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24442025-01-16T23:32:37.000ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
24452025-01-16T23:32:37.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24462025-01-16T23:32:37.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24472025-01-16T23:32:37.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24482025-01-16T23:32:37.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24492025-01-16T23:32:37.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24502025-01-16T23:32:37.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24512025-01-16T23:32:37.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24522025-01-16T23:32:37.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24532025-01-16T23:32:37.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24542025-01-16T23:32:37.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24552025-01-16T23:32:37.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
24562025-01-16T23:32:37.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24572025-01-16T23:32:37.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24582025-01-16T23:32:37.019ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
24592025-01-16T23:32:37.019ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.121007ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
24602025-01-16T23:32:37.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24612025-01-16T23:32:37.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24622025-01-16T23:32:37.058ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.947013ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24632025-01-16T23:32:37.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 21f9c3a7-c33f-416a-8999-7043d128e0e8 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24642025-01-16T23:32:37.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 21f9c3a7-c33f-416a-8999-7043d128e0e8 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24652025-01-16T23:32:37.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 21f9c3a7-c33f-416a-8999-7043d128e0e8 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24662025-01-16T23:32:38.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8d862d2b-9c5b-44af-812b-27d290b473ca roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24672025-01-16T23:32:38.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8d862d2b-9c5b-44af-812b-27d290b473ca resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24682025-01-16T23:32:38.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8d862d2b-9c5b-44af-812b-27d290b473ca response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24692025-01-16T23:32:39.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e302a19f-412b-40a1-8e37-821bb83a7e80 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24702025-01-16T23:32:39.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e302a19f-412b-40a1-8e37-821bb83a7e80 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24712025-01-16T23:32:39.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e302a19f-412b-40a1-8e37-821bb83a7e80 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24722025-01-16T23:32:40.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5f84a559-1b85-4a0c-a05c-d6061a4360c4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24732025-01-16T23:32:40.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5f84a559-1b85-4a0c-a05c-d6061a4360c4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24742025-01-16T23:32:40.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5f84a559-1b85-4a0c-a05c-d6061a4360c4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24752025-01-16T23:32:41.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e7ca3a58-c0cd-40b2-8a1f-ae5825d6b5d5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24762025-01-16T23:32:41.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e7ca3a58-c0cd-40b2-8a1f-ae5825d6b5d5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24772025-01-16T23:32:41.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e7ca3a58-c0cd-40b2-8a1f-ae5825d6b5d5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24782025-01-16T23:32:42.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9357c090-82b6-47a3-a1b5-64fba860ad77 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24792025-01-16T23:32:42.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9357c090-82b6-47a3-a1b5-64fba860ad77 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24802025-01-16T23:32:42.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9357c090-82b6-47a3-a1b5-64fba860ad77 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24812025-01-16T23:32:43.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b1c8a7f5-2d49-4ffe-b17d-52493b9b5787 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24822025-01-16T23:32:43.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b1c8a7f5-2d49-4ffe-b17d-52493b9b5787 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24832025-01-16T23:32:43.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b1c8a7f5-2d49-4ffe-b17d-52493b9b5787 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24842025-01-16T23:32:44.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 36b62133-055c-448f-ad5f-9546fb29c2ce roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24852025-01-16T23:32:44.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 36b62133-055c-448f-ad5f-9546fb29c2ce resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24862025-01-16T23:32:44.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 36b62133-055c-448f-ad5f-9546fb29c2ce response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24872025-01-16T23:32:45.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a2d6938d-1163-4f74-b49b-98ba0f0645bc roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24882025-01-16T23:32:45.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a2d6938d-1163-4f74-b49b-98ba0f0645bc resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24892025-01-16T23:32:45.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a2d6938d-1163-4f74-b49b-98ba0f0645bc response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24902025-01-16T23:32:45.731ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 477 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = d8e0b9de-87a0-4f3a-9881-1c574f26acc2 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
24912025-01-16T23:32:46.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f8b13acf-306d-414c-a5be-3b41c581965b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24922025-01-16T23:32:46.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f8b13acf-306d-414c-a5be-3b41c581965b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24932025-01-16T23:32:46.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f8b13acf-306d-414c-a5be-3b41c581965b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
24942025-01-16T23:32:47.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
24952025-01-16T23:32:47.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24962025-01-16T23:32:47.000ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
24972025-01-16T23:32:47.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24982025-01-16T23:32:47.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24992025-01-16T23:32:47.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25002025-01-16T23:32:47.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25012025-01-16T23:32:47.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25022025-01-16T23:32:47.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25032025-01-16T23:32:47.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25042025-01-16T23:32:47.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25052025-01-16T23:32:47.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25062025-01-16T23:32:47.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25072025-01-16T23:32:47.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
25082025-01-16T23:32:47.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25092025-01-16T23:32:47.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25102025-01-16T23:32:47.023ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
25112025-01-16T23:32:47.023ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.725356ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
25122025-01-16T23:32:47.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25132025-01-16T23:32:47.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25142025-01-16T23:32:47.067ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.039947ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25152025-01-16T23:32:47.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b748da36-7293-4092-b882-e44c42f660fd roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25162025-01-16T23:32:47.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b748da36-7293-4092-b882-e44c42f660fd resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25172025-01-16T23:32:47.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b748da36-7293-4092-b882-e44c42f660fd response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25182025-01-16T23:32:48.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fce060e4-81b5-46b8-a2ff-2fe79df74c08 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25192025-01-16T23:32:48.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fce060e4-81b5-46b8-a2ff-2fe79df74c08 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25202025-01-16T23:32:48.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fce060e4-81b5-46b8-a2ff-2fe79df74c08 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25212025-01-16T23:32:49.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a07ab424-cdad-42b3-91d2-5f4c7b91136e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25222025-01-16T23:32:49.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a07ab424-cdad-42b3-91d2-5f4c7b91136e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25232025-01-16T23:32:49.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a07ab424-cdad-42b3-91d2-5f4c7b91136e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25242025-01-16T23:32:50.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f9aa7b3e-d639-4322-a333-287234189b2c roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25252025-01-16T23:32:50.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f9aa7b3e-d639-4322-a333-287234189b2c resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25262025-01-16T23:32:50.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1761 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f9aa7b3e-d639-4322-a333-287234189b2c response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25272025-01-16T23:32:51.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e1ad06b7-4619-4a67-bc78-1ef30dc0ed0b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25282025-01-16T23:32:51.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e1ad06b7-4619-4a67-bc78-1ef30dc0ed0b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25292025-01-16T23:32:51.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e1ad06b7-4619-4a67-bc78-1ef30dc0ed0b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25302025-01-16T23:32:52.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2b7899b0-231e-4ef8-8722-71855c7a3a59 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25312025-01-16T23:32:52.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2b7899b0-231e-4ef8-8722-71855c7a3a59 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25322025-01-16T23:32:52.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2b7899b0-231e-4ef8-8722-71855c7a3a59 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25332025-01-16T23:32:53.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c4c959bb-1c22-43a1-a105-58fcfd4e7bc9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25342025-01-16T23:32:53.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c4c959bb-1c22-43a1-a105-58fcfd4e7bc9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25352025-01-16T23:32:53.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c4c959bb-1c22-43a1-a105-58fcfd4e7bc9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25362025-01-16T23:32:54.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0797d4a8-e0b7-418c-a0c6-880a2983d055 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25372025-01-16T23:32:54.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0797d4a8-e0b7-418c-a0c6-880a2983d055 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25382025-01-16T23:32:54.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0797d4a8-e0b7-418c-a0c6-880a2983d055 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25392025-01-16T23:32:55.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d0b3bbf6-36db-41ed-8876-64c75dd57b0b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25402025-01-16T23:32:55.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d0b3bbf6-36db-41ed-8876-64c75dd57b0b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25412025-01-16T23:32:55.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d0b3bbf6-36db-41ed-8876-64c75dd57b0b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25422025-01-16T23:32:55.732ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 542 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = faddd6d8-4d7a-4b1c-946a-05d6a56ffb3a response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
25432025-01-16T23:32:56.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9e842abd-102a-490d-93cd-fa866fc277fd roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25442025-01-16T23:32:56.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9e842abd-102a-490d-93cd-fa866fc277fd resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25452025-01-16T23:32:56.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9e842abd-102a-490d-93cd-fa866fc277fd response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
25462025-01-16T23:32:57.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
25472025-01-16T23:32:57.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25482025-01-16T23:32:57.000ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
25492025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25502025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
25512025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
25522025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25532025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
25542025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25552025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25562025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
25572025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
25582025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25592025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
25602025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
25612025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25622025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
25632025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25642025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
25652025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
25662025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25672025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
25682025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
25692025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25702025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
25712025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25722025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
25732025-01-16T23:32:57.001ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
25742025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25752025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
25762025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25772025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
25782025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
25792025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
25802025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
25812025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
25822025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25832025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25842025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25852025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25862025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25872025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25882025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25892025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25902025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25912025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
25922025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25932025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25942025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25952025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
25962025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
25972025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25982025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25992025-01-16T23:32:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26002025-01-16T23:32:57.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26012025-01-16T23:32:57.004ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26022025-01-16T23:32:57.004ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.625789ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26032025-01-16T23:32:57.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26042025-01-16T23:32:57.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26052025-01-16T23:32:57.005ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26062025-01-16T23:32:57.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26072025-01-16T23:32:57.007ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26082025-01-16T23:32:57.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
26092025-01-16T23:32:57.007ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26102025-01-16T23:32:57.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26112025-01-16T23:32:57.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
26122025-01-16T23:32:57.008ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26132025-01-16T23:32:57.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26142025-01-16T23:32:57.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26152025-01-16T23:32:57.009ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26162025-01-16T23:32:57.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26172025-01-16T23:32:57.010ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1485, tv_nsec: 327046595 } })
26182025-01-16T23:32:57.010ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1485, tv_nsec: 327064906 } })
26192025-01-16T23:32:57.011ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
26202025-01-16T23:32:57.011ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
26212025-01-16T23:32:57.014ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26222025-01-16T23:32:57.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26232025-01-16T23:32:57.014ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1485, tv_nsec: 330835948 } })
26242025-01-16T23:32:57.014ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
26252025-01-16T23:32:57.015ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26262025-01-16T23:32:57.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26272025-01-16T23:32:57.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26282025-01-16T23:32:57.018ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26292025-01-16T23:32:57.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26302025-01-16T23:32:57.018ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26312025-01-16T23:32:57.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26322025-01-16T23:32:57.021ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26332025-01-16T23:32:57.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26342025-01-16T23:32:57.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26352025-01-16T23:32:57.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
26362025-01-16T23:32:57.021ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26372025-01-16T23:32:57.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26382025-01-16T23:32:57.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26392025-01-16T23:32:57.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26402025-01-16T23:32:57.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26412025-01-16T23:32:57.023ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26422025-01-16T23:32:57.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26432025-01-16T23:32:57.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26442025-01-16T23:32:57.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26452025-01-16T23:32:57.038ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26462025-01-16T23:32:57.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26472025-01-16T23:32:57.054ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26482025-01-16T23:32:57.055ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
26492025-01-16T23:32:57.055ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26502025-01-16T23:32:57.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26512025-01-16T23:32:57.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26522025-01-16T23:32:57.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26532025-01-16T23:32:57.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26542025-01-16T23:32:57.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26552025-01-16T23:32:57.065ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26562025-01-16T23:32:57.065ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26572025-01-16T23:32:57.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26582025-01-16T23:32:57.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.360195ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
26592025-01-16T23:32:57.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26602025-01-16T23:32:57.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26612025-01-16T23:32:57.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26622025-01-16T23:32:57.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26632025-01-16T23:32:57.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26642025-01-16T23:32:57.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26652025-01-16T23:32:57.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26662025-01-16T23:32:57.070ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26672025-01-16T23:32:57.070ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 69.293691ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26682025-01-16T23:32:57.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.068506ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
26692025-01-16T23:32:57.072ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.087265ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26702025-01-16T23:32:57.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
26712025-01-16T23:32:57.073ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26722025-01-16T23:32:57.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26732025-01-16T23:32:57.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26742025-01-16T23:32:57.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26752025-01-16T23:32:57.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26762025-01-16T23:32:57.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26772025-01-16T23:32:57.080ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 79.507547ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
26782025-01-16T23:32:57.084ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
26792025-01-16T23:32:57.084ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.213938ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
26802025-01-16T23:32:57.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.201724ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26812025-01-16T23:32:57.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26822025-01-16T23:32:57.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
26832025-01-16T23:32:57.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26842025-01-16T23:32:57.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26852025-01-16T23:32:57.097ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26862025-01-16T23:32:57.098ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26872025-01-16T23:32:57.098ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
26882025-01-16T23:32:57.098ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26892025-01-16T23:32:57.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26902025-01-16T23:32:57.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
26912025-01-16T23:32:57.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26922025-01-16T23:32:57.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26932025-01-16T23:32:57.101ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 100.844737ms iteration = 18 status = 0
26942025-01-16T23:32:57.102ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
26952025-01-16T23:32:57.102ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26962025-01-16T23:32:57.103ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1777ba3-cf5b-433f-9c56-5639b379bfae", "content-length": "26", "date": "Thu, 16 Jan 2025 23:32:56 GMT"} })
26972025-01-16T23:32:57.103ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26982025-01-16T23:32:57.103ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
26992025-01-16T23:32:57.103ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 102.509219ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
27002025-01-16T23:32:57.105ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27012025-01-16T23:32:57.128ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
27022025-01-16T23:32:57.128ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 127.290565ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
27032025-01-16T23:32:57.132ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27042025-01-16T23:32:57.132ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27052025-01-16T23:32:57.132ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 131.588208ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
27062025-01-16T23:32:57.162ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 161.737386ms iteration = 20 status = {"physical_disks_added":0}
27072025-01-16T23:32:57.162ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
27082025-01-16T23:32:57.162ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27092025-01-16T23:32:57.163ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "19ded083-6585-49b5-9887-aa8b77fb084c", "content-length": "26", "date": "Thu, 16 Jan 2025 23:32:56 GMT"} })
27102025-01-16T23:32:57.163ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27112025-01-16T23:32:57.164ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27122025-01-16T23:32:57.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27132025-01-16T23:32:57.164ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
27142025-01-16T23:32:57.164ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
27152025-01-16T23:32:57.164ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27162025-01-16T23:32:57.165ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd64af16-79a9-416e-9b69-e5799d4636f6", "content-length": "26", "date": "Thu, 16 Jan 2025 23:32:56 GMT"} })
27172025-01-16T23:32:57.165ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27182025-01-16T23:32:57.167ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27192025-01-16T23:32:57.218ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
27202025-01-16T23:32:57.218ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27212025-01-16T23:32:57.230ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 229.849074ms iteration = 18 status = {}
27222025-01-16T23:32:57.241ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27232025-01-16T23:32:57.241ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "adcdd54f-232f-48c0-909c-a28946b70443", "content-length": "1", "date": "Thu, 16 Jan 2025 23:32:56 GMT"} })
27242025-01-16T23:32:57.244ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27252025-01-16T23:32:57.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27262025-01-16T23:32:57.246ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 245.582577ms iteration = 18 status = null
27272025-01-16T23:32:57.278ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "375e8bbf-dd19-4385-b02a-21638a6f694e", "content-length": "372", "date": "Thu, 16 Jan 2025 23:32:57 GMT"} })
27282025-01-16T23:32:57.278ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27292025-01-16T23:32:57.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27302025-01-16T23:32:57.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27312025-01-16T23:32:57.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27322025-01-16T23:32:57.303ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
27332025-01-16T23:32:57.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27342025-01-16T23:32:57.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27352025-01-16T23:32:57.313ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27362025-01-16T23:32:57.314ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bf72be7-ac48-49cc-8e24-97bb63c67a93", "content-length": "134", "date": "Thu, 16 Jan 2025 23:32:56 GMT"} })
27372025-01-16T23:32:57.314ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
27382025-01-16T23:32:57.314ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
27392025-01-16T23:32:57.314ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27402025-01-16T23:32:57.314ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27412025-01-16T23:32:57.314ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27422025-01-16T23:32:57.314ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27432025-01-16T23:32:57.314ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27442025-01-16T23:32:57.314ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27452025-01-16T23:32:57.314ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27462025-01-16T23:32:57.314ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27472025-01-16T23:32:57.315ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
27482025-01-16T23:32:57.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27492025-01-16T23:32:57.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27502025-01-16T23:32:57.316ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27512025-01-16T23:32:57.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27522025-01-16T23:32:57.320ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27532025-01-16T23:32:57.320ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27542025-01-16T23:32:57.320ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1782d223-a28a-4f9d-8593-eeca5a524da9", "content-length": "2", "date": "Thu, 16 Jan 2025 23:32:56 GMT"} })
27552025-01-16T23:32:57.320ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27562025-01-16T23:32:57.320ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a70311d-5574-4b54-8b0d-67f4e28db95b", "content-length": "52", "date": "Thu, 16 Jan 2025 23:32:56 GMT"} })
27572025-01-16T23:32:57.320ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
27582025-01-16T23:32:57.320ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27592025-01-16T23:32:57.322ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27602025-01-16T23:32:57.322ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27612025-01-16T23:32:57.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27622025-01-16T23:32:57.324ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27632025-01-16T23:32:57.324ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
27642025-01-16T23:32:57.324ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
27652025-01-16T23:32:57.326ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27662025-01-16T23:32:57.326ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27672025-01-16T23:32:57.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27682025-01-16T23:32:57.361ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
27692025-01-16T23:32:57.419ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "47718912-0ed7-46c8-9561-caec783291da", "date": "Thu, 16 Jan 2025 23:32:57 GMT"} })
27702025-01-16T23:32:57.419ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
27712025-01-16T23:32:57.419ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27722025-01-16T23:32:57.419ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6ae56cb3-f455-46dc-b7a1-462f89aa8e89", "date": "Thu, 16 Jan 2025 23:32:57 GMT"} })
27732025-01-16T23:32:57.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27742025-01-16T23:32:57.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27752025-01-16T23:32:57.420ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecf6b9c1-b06c-4486-bab8-08bdb2c4689e", "content-length": "682", "date": "Thu, 16 Jan 2025 23:32:57 GMT"} })
27762025-01-16T23:32:57.420ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ba61673-35b4-45fc-84b1-42426b4330f7", "content-length": "691", "date": "Thu, 16 Jan 2025 23:32:57 GMT"} })
27772025-01-16T23:32:57.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27782025-01-16T23:32:57.420ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
27792025-01-16T23:32:57.420ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
27802025-01-16T23:32:57.420ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
27812025-01-16T23:32:57.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27822025-01-16T23:32:57.421ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 420.369124ms iteration = 18 status = {}
27832025-01-16T23:32:57.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27842025-01-16T23:32:57.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27852025-01-16T23:32:57.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27862025-01-16T23:32:57.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27872025-01-16T23:32:57.426ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27882025-01-16T23:32:57.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27892025-01-16T23:32:57.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27902025-01-16T23:32:57.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27912025-01-16T23:32:57.429ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
27922025-01-16T23:32:57.429ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27932025-01-16T23:32:57.429ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "07bab054-406e-48e4-8930-5b6bf1898e32", "date": "Thu, 16 Jan 2025 23:32:57 GMT"} })
27942025-01-16T23:32:57.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27952025-01-16T23:32:57.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27962025-01-16T23:32:57.431ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 430.06135ms iteration = 18 status = {}
27972025-01-16T23:32:57.437ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 436.421052ms iteration = 18 status = {}
27982025-01-16T23:32:57.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ab811bb5-1252-437a-b870-00e7dfa4561a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
27992025-01-16T23:32:57.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ab811bb5-1252-437a-b870-00e7dfa4561a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28002025-01-16T23:32:57.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ab811bb5-1252-437a-b870-00e7dfa4561a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28012025-01-16T23:32:58.005ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
28022025-01-16T23:32:58.005ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
28032025-01-16T23:32:58.035ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
28042025-01-16T23:32:58.036ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:59794
28052025-01-16T23:32:58.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59794 req_id = ddb793c1-f36a-420b-824f-a5be4be936d7 roles = RoleSet { roles: {} } uri = /metrics/producers
28062025-01-16T23:32:58.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59794 req_id = ddb793c1-f36a-420b-824f-a5be4be936d7 resource = Database result = Ok(()) uri = /metrics/producers
28072025-01-16T23:32:58.074ZINFOnexus: assigned collector to new producer collector_id = 0a365f9e-6c70-4a27-ba2b-6123ad53013e file = nexus/src/app/oximeter.rs:76 producer_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
28082025-01-16T23:32:58.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38277 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59794 req_id = ddb793c1-f36a-420b-824f-a5be4be936d7 response_code = 201 uri = /metrics/producers
28092025-01-16T23:32:58.074ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "ddb793c1-f36a-420b-824f-a5be4be936d7", "content-length": "41", "date": "Thu, 16 Jan 2025 23:32:58 GMT"} })
28102025-01-16T23:32:58.075ZDEBGnexus (producer-registration-task): registered with nexus successfully
28112025-01-16T23:32:58.075ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
28122025-01-16T23:32:58.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3cbcafdc-c333-4e3a-b457-49c719224a13 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28132025-01-16T23:32:58.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3cbcafdc-c333-4e3a-b457-49c719224a13 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28142025-01-16T23:32:58.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3cbcafdc-c333-4e3a-b457-49c719224a13 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28152025-01-16T23:32:59.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b4870d21-aceb-4959-b5ae-3288e02305fd roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28162025-01-16T23:32:59.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b4870d21-aceb-4959-b5ae-3288e02305fd resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28172025-01-16T23:32:59.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b4870d21-aceb-4959-b5ae-3288e02305fd response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28182025-01-16T23:33:00.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 462af5e4-c2e5-4d77-998d-ef5459639076 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28192025-01-16T23:33:00.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 462af5e4-c2e5-4d77-998d-ef5459639076 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28202025-01-16T23:33:00.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 462af5e4-c2e5-4d77-998d-ef5459639076 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28212025-01-16T23:33:01.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aaa4c383-8d81-4577-ba30-f6478fafad3e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28222025-01-16T23:33:01.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aaa4c383-8d81-4577-ba30-f6478fafad3e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28232025-01-16T23:33:01.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aaa4c383-8d81-4577-ba30-f6478fafad3e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28242025-01-16T23:33:02.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 18b12cbe-403d-43d3-af5d-ef1060adc803 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28252025-01-16T23:33:02.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 18b12cbe-403d-43d3-af5d-ef1060adc803 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28262025-01-16T23:33:02.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 18b12cbe-403d-43d3-af5d-ef1060adc803 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28272025-01-16T23:33:03.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8dd9675a-dea7-4db8-9dea-77f4a413887d roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28282025-01-16T23:33:03.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8dd9675a-dea7-4db8-9dea-77f4a413887d resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28292025-01-16T23:33:03.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8dd9675a-dea7-4db8-9dea-77f4a413887d response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28302025-01-16T23:33:04.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 43fc9865-e2a5-4b77-beb3-e80be219b1ab roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28312025-01-16T23:33:04.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 43fc9865-e2a5-4b77-beb3-e80be219b1ab resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28322025-01-16T23:33:04.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 43fc9865-e2a5-4b77-beb3-e80be219b1ab response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28332025-01-16T23:33:05.731ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 525 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 3e937afc-2a98-4d07-bcbc-a8eb8d2ae9a9 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
28342025-01-16T23:33:05.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 208a8425-c9b0-4c8f-84fd-851d95a13c7b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28352025-01-16T23:33:05.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 208a8425-c9b0-4c8f-84fd-851d95a13c7b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28362025-01-16T23:33:05.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 208a8425-c9b0-4c8f-84fd-851d95a13c7b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28372025-01-16T23:33:06.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6d61e73e-198d-46c3-84b9-41a40866d3bf roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28382025-01-16T23:33:06.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6d61e73e-198d-46c3-84b9-41a40866d3bf resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28392025-01-16T23:33:06.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6d61e73e-198d-46c3-84b9-41a40866d3bf response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28402025-01-16T23:33:07.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
28412025-01-16T23:33:07.000ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
28422025-01-16T23:33:07.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28432025-01-16T23:33:07.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28442025-01-16T23:33:07.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28452025-01-16T23:33:07.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28462025-01-16T23:33:07.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28472025-01-16T23:33:07.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28482025-01-16T23:33:07.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28492025-01-16T23:33:07.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28502025-01-16T23:33:07.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28512025-01-16T23:33:07.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28522025-01-16T23:33:07.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28532025-01-16T23:33:07.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28542025-01-16T23:33:07.058ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.921012ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28552025-01-16T23:33:07.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28562025-01-16T23:33:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
28572025-01-16T23:33:07.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28582025-01-16T23:33:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28592025-01-16T23:33:07.075ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
28602025-01-16T23:33:07.075ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.639454ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
28612025-01-16T23:33:07.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bffc3f3f-b5b3-4e65-91ea-b9e53809511f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28622025-01-16T23:33:07.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bffc3f3f-b5b3-4e65-91ea-b9e53809511f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28632025-01-16T23:33:07.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bffc3f3f-b5b3-4e65-91ea-b9e53809511f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28642025-01-16T23:33:09.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 45e32c6a-99d1-44de-8f67-a96ca7fb31b4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28652025-01-16T23:33:09.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 45e32c6a-99d1-44de-8f67-a96ca7fb31b4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28662025-01-16T23:33:09.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 45e32c6a-99d1-44de-8f67-a96ca7fb31b4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28672025-01-16T23:33:10.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4c924c64-cc80-4c01-b147-694f2945c24e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28682025-01-16T23:33:10.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4c924c64-cc80-4c01-b147-694f2945c24e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28692025-01-16T23:33:10.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4c924c64-cc80-4c01-b147-694f2945c24e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28702025-01-16T23:33:11.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6262dfc8-c5a6-46f4-a940-845efc06c888 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28712025-01-16T23:33:11.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6262dfc8-c5a6-46f4-a940-845efc06c888 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28722025-01-16T23:33:11.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6262dfc8-c5a6-46f4-a940-845efc06c888 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28732025-01-16T23:33:12.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8c9dcdc9-8a6b-41bb-8852-0e98296b54c1 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28742025-01-16T23:33:12.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8c9dcdc9-8a6b-41bb-8852-0e98296b54c1 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28752025-01-16T23:33:12.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8c9dcdc9-8a6b-41bb-8852-0e98296b54c1 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28762025-01-16T23:33:13.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 32975e12-c42b-421b-a2c0-eb1ecb3dfe33 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28772025-01-16T23:33:13.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 32975e12-c42b-421b-a2c0-eb1ecb3dfe33 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28782025-01-16T23:33:13.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 32975e12-c42b-421b-a2c0-eb1ecb3dfe33 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28792025-01-16T23:33:14.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 60dc5539-d2d3-493b-bd42-a341d1723e01 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28802025-01-16T23:33:14.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 60dc5539-d2d3-493b-bd42-a341d1723e01 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28812025-01-16T23:33:14.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 60dc5539-d2d3-493b-bd42-a341d1723e01 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28822025-01-16T23:33:15.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f72f4238-8dd0-4aa4-8955-93c0e8dae9fb roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28832025-01-16T23:33:15.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f72f4238-8dd0-4aa4-8955-93c0e8dae9fb resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28842025-01-16T23:33:15.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f72f4238-8dd0-4aa4-8955-93c0e8dae9fb response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28852025-01-16T23:33:15.731ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 482 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = e4293b4c-216d-49c7-b735-22b8af87f132 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
28862025-01-16T23:33:16.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8bf1ff3d-4c38-4018-ac36-c8c057b49598 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28872025-01-16T23:33:16.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8bf1ff3d-4c38-4018-ac36-c8c057b49598 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28882025-01-16T23:33:16.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8bf1ff3d-4c38-4018-ac36-c8c057b49598 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
28892025-01-16T23:33:17.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
28902025-01-16T23:33:17.000ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
28912025-01-16T23:33:17.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28922025-01-16T23:33:17.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28932025-01-16T23:33:17.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28942025-01-16T23:33:17.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28952025-01-16T23:33:17.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28962025-01-16T23:33:17.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28972025-01-16T23:33:17.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28982025-01-16T23:33:17.032ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.697658ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28992025-01-16T23:33:17.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29002025-01-16T23:33:17.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29012025-01-16T23:33:17.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29022025-01-16T23:33:17.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29032025-01-16T23:33:17.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29042025-01-16T23:33:17.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29052025-01-16T23:33:17.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
29062025-01-16T23:33:17.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29072025-01-16T23:33:17.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29082025-01-16T23:33:17.047ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
29092025-01-16T23:33:17.047ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.223167ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
29102025-01-16T23:33:17.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f72e29c0-b711-4daa-97c2-642477da872f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29112025-01-16T23:33:17.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f72e29c0-b711-4daa-97c2-642477da872f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29122025-01-16T23:33:17.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1780 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f72e29c0-b711-4daa-97c2-642477da872f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29132025-01-16T23:33:18.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3662f3b1-7e55-4259-bbf0-c029c74394ef roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29142025-01-16T23:33:18.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3662f3b1-7e55-4259-bbf0-c029c74394ef resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29152025-01-16T23:33:18.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3662f3b1-7e55-4259-bbf0-c029c74394ef response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29162025-01-16T23:33:19.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 416d5bef-a003-4ae8-866e-6e6660a31295 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29172025-01-16T23:33:19.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 416d5bef-a003-4ae8-866e-6e6660a31295 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29182025-01-16T23:33:19.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 416d5bef-a003-4ae8-866e-6e6660a31295 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29192025-01-16T23:33:20.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 22b959f7-59d2-46b0-b844-d78ed47dae4d roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29202025-01-16T23:33:20.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 22b959f7-59d2-46b0-b844-d78ed47dae4d resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29212025-01-16T23:33:20.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 22b959f7-59d2-46b0-b844-d78ed47dae4d response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29222025-01-16T23:33:20.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 0d8d6ff2-2cb1-4155-847a-c92151ffd90c roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
29232025-01-16T23:33:20.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 0d8d6ff2-2cb1-4155-847a-c92151ffd90c resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
29242025-01-16T23:33:20.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 0d8d6ff2-2cb1-4155-847a-c92151ffd90c response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
29252025-01-16T23:33:20.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = e4983811-d587-4da9-a85c-69ddf8f0f8e3 roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
29262025-01-16T23:33:20.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = e4983811-d587-4da9-a85c-69ddf8f0f8e3 resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
29272025-01-16T23:33:20.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = e4983811-d587-4da9-a85c-69ddf8f0f8e3 response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
29282025-01-16T23:33:21.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e9d81e52-817f-471f-a3fd-18d0c903c382 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29292025-01-16T23:33:21.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e9d81e52-817f-471f-a3fd-18d0c903c382 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29302025-01-16T23:33:21.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e9d81e52-817f-471f-a3fd-18d0c903c382 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29312025-01-16T23:33:22.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 987cd5e6-7df1-4fc2-b11e-5476be414b24 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29322025-01-16T23:33:22.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 987cd5e6-7df1-4fc2-b11e-5476be414b24 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29332025-01-16T23:33:22.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 987cd5e6-7df1-4fc2-b11e-5476be414b24 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29342025-01-16T23:33:23.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 731637d8-0e77-46c8-a592-498606dfc034 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29352025-01-16T23:33:23.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 731637d8-0e77-46c8-a592-498606dfc034 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29362025-01-16T23:33:23.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 731637d8-0e77-46c8-a592-498606dfc034 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29372025-01-16T23:33:24.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 303a6db1-5ac9-4cab-b76e-3e979a666e75 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29382025-01-16T23:33:24.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 303a6db1-5ac9-4cab-b76e-3e979a666e75 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29392025-01-16T23:33:24.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 303a6db1-5ac9-4cab-b76e-3e979a666e75 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29402025-01-16T23:33:25.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 485dde33-de41-47c6-9a3f-7b85ab3019f5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29412025-01-16T23:33:25.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 485dde33-de41-47c6-9a3f-7b85ab3019f5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29422025-01-16T23:33:25.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 485dde33-de41-47c6-9a3f-7b85ab3019f5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29432025-01-16T23:33:25.732ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 516 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 29d2b6e6-43d1-4ca9-ab9e-55c4e1677c4c response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
29442025-01-16T23:33:26.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c4b383a1-78de-4570-b962-8517610209d7 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29452025-01-16T23:33:26.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c4b383a1-78de-4570-b962-8517610209d7 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29462025-01-16T23:33:26.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c4b383a1-78de-4570-b962-8517610209d7 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
29472025-01-16T23:33:27.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
29482025-01-16T23:33:27.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29492025-01-16T23:33:27.000ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
29502025-01-16T23:33:27.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29512025-01-16T23:33:27.000ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
29522025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
29532025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
29542025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
29552025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
29562025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
29572025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29582025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29592025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
29602025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
29612025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
29622025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
29632025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
29642025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29652025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
29662025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29672025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
29682025-01-16T23:33:27.001ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
29692025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29702025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
29712025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29722025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
29732025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
29742025-01-16T23:33:27.001ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca
29752025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
29762025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.45\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca"}
29772025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
29782025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29792025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29802025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
29812025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
29822025-01-16T23:33:27.001ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-16 23:23:27.001146070 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
29832025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
29842025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
29852025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
29862025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
29872025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29882025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29892025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29902025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
29912025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
29922025-01-16T23:33:27.001ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
29932025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29942025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29952025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
29962025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29972025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
29982025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29992025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
30002025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30012025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30022025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30032025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30042025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30052025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30062025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30072025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30082025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30092025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30102025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30112025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30122025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
30132025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
30142025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
30152025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
30162025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
30172025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
30182025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30192025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
30202025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
30212025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
30222025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30232025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30242025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30252025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
30262025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
30272025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
30282025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30292025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30302025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30312025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30322025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30332025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30342025-01-16T23:33:27.001ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5c1ab32c-50b8-4564-bf29-e388b915cbdb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd10c057-8c9f-4db2-98b5-bcf5e0d536ba.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 317670425 } })
30352025-01-16T23:33:27.001ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dc5f3810-93b6-44f1-815c-44411abf99ad.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 317687365 } })
30362025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30372025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30382025-01-16T23:33:27.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
30392025-01-16T23:33:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30402025-01-16T23:33:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
30412025-01-16T23:33:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
30422025-01-16T23:33:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
30432025-01-16T23:33:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30442025-01-16T23:33:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30452025-01-16T23:33:27.002ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30462025-01-16T23:33:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30472025-01-16T23:33:27.002ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30482025-01-16T23:33:27.002ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
30492025-01-16T23:33:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30502025-01-16T23:33:27.002ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.419618ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
30512025-01-16T23:33:27.002ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
30522025-01-16T23:33:27.002ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.511839ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
30532025-01-16T23:33:27.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30542025-01-16T23:33:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30552025-01-16T23:33:27.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30562025-01-16T23:33:27.004ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 320647092 } })
30572025-01-16T23:33:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30582025-01-16T23:33:27.005ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
30592025-01-16T23:33:27.005ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.229051ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
30602025-01-16T23:33:27.006ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30612025-01-16T23:33:27.007ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30622025-01-16T23:33:27.008ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 324464776 } })
30632025-01-16T23:33:27.008ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
30642025-01-16T23:33:27.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
30652025-01-16T23:33:27.009ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30662025-01-16T23:33:27.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30672025-01-16T23:33:27.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30682025-01-16T23:33:27.010ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30692025-01-16T23:33:27.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30702025-01-16T23:33:27.013ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-16 23:23:27.001146070 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
30712025-01-16T23:33:27.013ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.558121ms iteration = 10 status = {"expiration":"2025-01-16T23:23:27.001146070Z","pruned":[]}
30722025-01-16T23:33:27.013ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30732025-01-16T23:33:27.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
30742025-01-16T23:33:27.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30752025-01-16T23:33:27.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30762025-01-16T23:33:27.024ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.982512ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
30772025-01-16T23:33:27.029ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 28.177352ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
30782025-01-16T23:33:27.031ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30792025-01-16T23:33:27.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30802025-01-16T23:33:27.035ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30812025-01-16T23:33:27.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30822025-01-16T23:33:27.047ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30832025-01-16T23:33:27.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30842025-01-16T23:33:27.051ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30852025-01-16T23:33:27.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30862025-01-16T23:33:27.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30872025-01-16T23:33:27.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30882025-01-16T23:33:27.054ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30892025-01-16T23:33:27.054ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30902025-01-16T23:33:27.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30912025-01-16T23:33:27.058ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30922025-01-16T23:33:27.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
30932025-01-16T23:33:27.058ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30942025-01-16T23:33:27.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30952025-01-16T23:33:27.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30962025-01-16T23:33:27.060ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30972025-01-16T23:33:27.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30982025-01-16T23:33:27.061ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30992025-01-16T23:33:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31002025-01-16T23:33:27.063ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31012025-01-16T23:33:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31022025-01-16T23:33:27.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31032025-01-16T23:33:27.066ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31042025-01-16T23:33:27.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31052025-01-16T23:33:27.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31062025-01-16T23:33:27.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31072025-01-16T23:33:27.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31082025-01-16T23:33:27.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31092025-01-16T23:33:27.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31102025-01-16T23:33:27.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
31112025-01-16T23:33:27.069ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31122025-01-16T23:33:27.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31132025-01-16T23:33:27.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31142025-01-16T23:33:27.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31152025-01-16T23:33:27.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31162025-01-16T23:33:27.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31172025-01-16T23:33:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31182025-01-16T23:33:27.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31192025-01-16T23:33:27.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31202025-01-16T23:33:27.073ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31212025-01-16T23:33:27.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31222025-01-16T23:33:27.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31232025-01-16T23:33:27.074ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31242025-01-16T23:33:27.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31252025-01-16T23:33:27.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31262025-01-16T23:33:27.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31272025-01-16T23:33:27.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31282025-01-16T23:33:27.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 74.413709ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
31292025-01-16T23:33:27.079ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 395231245 } })
31302025-01-16T23:33:27.079ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31312025-01-16T23:33:27.079ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
31322025-01-16T23:33:27.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31332025-01-16T23:33:27.080ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 79.273473ms iteration = 5 status = {"nsuccess":5}
31342025-01-16T23:33:27.080ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31352025-01-16T23:33:27.080ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31362025-01-16T23:33:27.080ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31372025-01-16T23:33:27.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31382025-01-16T23:33:27.080ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31392025-01-16T23:33:27.081ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.975626ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31402025-01-16T23:33:27.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31412025-01-16T23:33:27.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31422025-01-16T23:33:27.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31432025-01-16T23:33:27.082ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31442025-01-16T23:33:27.083ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31452025-01-16T23:33:27.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31462025-01-16T23:33:27.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31472025-01-16T23:33:27.083ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
31482025-01-16T23:33:27.083ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
31492025-01-16T23:33:27.083ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 82.073976ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
31502025-01-16T23:33:27.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31512025-01-16T23:33:27.084ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31522025-01-16T23:33:27.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31532025-01-16T23:33:27.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31542025-01-16T23:33:27.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31552025-01-16T23:33:27.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
31562025-01-16T23:33:27.086ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31572025-01-16T23:33:27.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31582025-01-16T23:33:27.088ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31592025-01-16T23:33:27.088ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31602025-01-16T23:33:27.088ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31612025-01-16T23:33:27.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31622025-01-16T23:33:27.088ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31632025-01-16T23:33:27.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31642025-01-16T23:33:27.088ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31652025-01-16T23:33:27.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31662025-01-16T23:33:27.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31672025-01-16T23:33:27.091ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31682025-01-16T23:33:27.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31692025-01-16T23:33:27.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
31702025-01-16T23:33:27.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31712025-01-16T23:33:27.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31722025-01-16T23:33:27.095ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31732025-01-16T23:33:27.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31742025-01-16T23:33:27.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31752025-01-16T23:33:27.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31762025-01-16T23:33:27.108ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
31772025-01-16T23:33:27.108ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
31782025-01-16T23:33:27.108ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 107.24356ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
31792025-01-16T23:33:27.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31802025-01-16T23:33:27.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31812025-01-16T23:33:27.113ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
31822025-01-16T23:33:27.113ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
31832025-01-16T23:33:27.113ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
31842025-01-16T23:33:27.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31852025-01-16T23:33:27.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31862025-01-16T23:33:27.117ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31872025-01-16T23:33:27.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31882025-01-16T23:33:27.121ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 120.740909ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31892025-01-16T23:33:27.128ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31902025-01-16T23:33:27.128ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 127.197933ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
31912025-01-16T23:33:27.128ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31922025-01-16T23:33:27.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31932025-01-16T23:33:27.131ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31942025-01-16T23:33:27.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31952025-01-16T23:33:27.142ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
31962025-01-16T23:33:27.145ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
31972025-01-16T23:33:27.145ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
31982025-01-16T23:33:27.145ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
31992025-01-16T23:33:27.145ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32002025-01-16T23:33:27.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32012025-01-16T23:33:27.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32022025-01-16T23:33:27.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32032025-01-16T23:33:27.162ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
32042025-01-16T23:33:27.162ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32052025-01-16T23:33:27.163ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "29b812a5-70c5-4faf-871b-a109d3882764", "content-length": "26", "date": "Thu, 16 Jan 2025 23:33:26 GMT"} })
32062025-01-16T23:33:27.163ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32072025-01-16T23:33:27.164ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32082025-01-16T23:33:27.249ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
32092025-01-16T23:33:27.250ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32102025-01-16T23:33:27.250ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a16fca78-f9a5-420d-9406-9665d230afff", "content-length": "26", "date": "Thu, 16 Jan 2025 23:33:26 GMT"} })
32112025-01-16T23:33:27.250ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32122025-01-16T23:33:27.252ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
32132025-01-16T23:33:27.258ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32142025-01-16T23:33:27.258ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32152025-01-16T23:33:27.259ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "57246507-58a4-41cf-bd7d-1d3d1554aca8", "content-length": "372", "date": "Thu, 16 Jan 2025 23:33:27 GMT"} })
32162025-01-16T23:33:27.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32172025-01-16T23:33:27.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32182025-01-16T23:33:27.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32192025-01-16T23:33:27.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32202025-01-16T23:33:27.264ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32212025-01-16T23:33:27.266ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32222025-01-16T23:33:27.267ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32232025-01-16T23:33:27.267ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32242025-01-16T23:33:27.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32252025-01-16T23:33:27.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
32262025-01-16T23:33:27.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32272025-01-16T23:33:27.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32282025-01-16T23:33:27.271ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 270.657868ms iteration = 19 status = 0
32292025-01-16T23:33:27.291ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
32302025-01-16T23:33:27.291ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 290.077051ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
32312025-01-16T23:33:27.295ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
32322025-01-16T23:33:27.295ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32332025-01-16T23:33:27.295ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 294.251541ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
32342025-01-16T23:33:27.296ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c0fb7e9-7b96-4838-9033-4ebac0f653e8", "content-length": "26", "date": "Thu, 16 Jan 2025 23:33:26 GMT"} })
32352025-01-16T23:33:27.296ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32362025-01-16T23:33:27.297ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32372025-01-16T23:33:27.300ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
32382025-01-16T23:33:27.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32392025-01-16T23:33:27.306ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32402025-01-16T23:33:27.306ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32412025-01-16T23:33:27.306ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 305.669851ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32422025-01-16T23:33:27.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32432025-01-16T23:33:27.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32442025-01-16T23:33:27.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32452025-01-16T23:33:27.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 308.030026ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32462025-01-16T23:33:27.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32472025-01-16T23:33:27.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32482025-01-16T23:33:27.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32492025-01-16T23:33:27.313ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
32502025-01-16T23:33:27.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32512025-01-16T23:33:27.319ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32522025-01-16T23:33:27.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
32532025-01-16T23:33:27.322ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32542025-01-16T23:33:27.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32552025-01-16T23:33:27.323ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-16T23:24:20.471931Z, time_modified: 2025-01-16T23:24:20.471931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }) }
32562025-01-16T23:33:27.323ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 322.695668ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]}},"default_endpoint":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
32572025-01-16T23:33:27.327ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
32582025-01-16T23:33:27.327ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32592025-01-16T23:33:27.327ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d9e92b33-fbf7-446f-97fc-341bfa2f98a7", "date": "Thu, 16 Jan 2025 23:33:27 GMT"} })
32602025-01-16T23:33:27.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32612025-01-16T23:33:27.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32622025-01-16T23:33:27.331ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32632025-01-16T23:33:27.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32642025-01-16T23:33:27.332ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
32652025-01-16T23:33:27.332ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3209f43b-b1cc-4ccd-ad21-a49376b129d0", "content-length": "1", "date": "Thu, 16 Jan 2025 23:33:26 GMT"} })
32662025-01-16T23:33:27.334ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32672025-01-16T23:33:27.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32682025-01-16T23:33:27.335ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32692025-01-16T23:33:27.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32702025-01-16T23:33:27.336ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 335.197597ms iteration = 19 status = null
32712025-01-16T23:33:27.339ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
32722025-01-16T23:33:27.339ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32732025-01-16T23:33:27.339ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "93deed87-5cb6-41a4-8776-c3d49768cb26", "date": "Thu, 16 Jan 2025 23:33:27 GMT"} })
32742025-01-16T23:33:27.340ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
32752025-01-16T23:33:27.340ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
32762025-01-16T23:33:27.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32772025-01-16T23:33:27.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32782025-01-16T23:33:27.341ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 340.03745ms iteration = 19 status = {}
32792025-01-16T23:33:27.346ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
32802025-01-16T23:33:27.346ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 0 version = 2
32812025-01-16T23:33:27.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32822025-01-16T23:33:27.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32832025-01-16T23:33:27.347ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32842025-01-16T23:33:27.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32852025-01-16T23:33:27.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32862025-01-16T23:33:27.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32872025-01-16T23:33:27.352ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
32882025-01-16T23:33:27.352ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 351.269087ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
32892025-01-16T23:33:27.352ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 1 version = 2
32902025-01-16T23:33:27.352ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
32912025-01-16T23:33:27.352ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-16 23:25:21.695734 UTC dns_group = external generation = 2
32922025-01-16T23:33:27.352ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 351.792326ms iteration = 10 status = {"generation":2}
32932025-01-16T23:33:27.377ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 376.576172ms iteration = 21 status = {"physical_disks_added":0}
32942025-01-16T23:33:27.383ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32952025-01-16T23:33:27.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32962025-01-16T23:33:27.386ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32972025-01-16T23:33:27.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32982025-01-16T23:33:27.387ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
32992025-01-16T23:33:27.387ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 386.85786ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
33002025-01-16T23:33:27.389ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
33012025-01-16T23:33:27.389ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
33022025-01-16T23:33:27.389ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-16 23:25:20.756297 UTC dns_group = internal generation = 1
33032025-01-16T23:33:27.389ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 388.728166ms iteration = 10 status = {"generation":1}
33042025-01-16T23:33:27.394ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33052025-01-16T23:33:27.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33062025-01-16T23:33:27.405ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 404.157452ms iteration = 19 status = {}
33072025-01-16T23:33:27.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a1ab9379-eb2c-4326-9f9c-9b7abca8e534 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33082025-01-16T23:33:27.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a1ab9379-eb2c-4326-9f9c-9b7abca8e534 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33092025-01-16T23:33:27.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a1ab9379-eb2c-4326-9f9c-9b7abca8e534 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33102025-01-16T23:33:27.420ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
33112025-01-16T23:33:27.421ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
33122025-01-16T23:33:27.421ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ef374160-31ed-4acb-9f4c-764dbb680d15", "date": "Thu, 16 Jan 2025 23:33:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
33132025-01-16T23:33:27.421ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
33142025-01-16T23:33:27.421ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "dda33c97-7a96-4f37-befb-3851aa5bf196", "date": "Thu, 16 Jan 2025 23:33:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33152025-01-16T23:33:27.421ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33162025-01-16T23:33:27.423ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "48124c1d-f44a-4ea9-b2de-8bbfe866a726", "date": "Thu, 16 Jan 2025 23:33:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33172025-01-16T23:33:27.423ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33182025-01-16T23:33:27.423ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8a5c63ad-084b-44a8-a251-14b01cf0ebb2", "date": "Thu, 16 Jan 2025 23:33:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
33192025-01-16T23:33:27.423ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
33202025-01-16T23:33:27.425ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33212025-01-16T23:33:27.425ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 424.778938ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
33222025-01-16T23:33:27.426ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7c1bc662-03e3-4901-a2e4-ffc42b5ff4da", "date": "Thu, 16 Jan 2025 23:33:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
33232025-01-16T23:33:27.426ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
33242025-01-16T23:33:27.428ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
33252025-01-16T23:33:27.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33262025-01-16T23:33:27.428ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 427.119463ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
33272025-01-16T23:33:27.430ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33282025-01-16T23:33:27.430ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33292025-01-16T23:33:27.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33302025-01-16T23:33:27.431ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33312025-01-16T23:33:27.433ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33322025-01-16T23:33:27.433ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33332025-01-16T23:33:27.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33342025-01-16T23:33:27.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33352025-01-16T23:33:27.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33362025-01-16T23:33:27.476ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
33372025-01-16T23:33:27.476ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33382025-01-16T23:33:27.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33392025-01-16T23:33:27.487ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33402025-01-16T23:33:27.487ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e05a8352-85a0-40bf-a27e-ccf67a79e41a", "content-length": "134", "date": "Thu, 16 Jan 2025 23:33:26 GMT"} })
33412025-01-16T23:33:27.487ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
33422025-01-16T23:33:27.487ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
33432025-01-16T23:33:27.488ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
33442025-01-16T23:33:27.488ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33452025-01-16T23:33:27.488ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33462025-01-16T23:33:27.488ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33472025-01-16T23:33:27.488ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33482025-01-16T23:33:27.488ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33492025-01-16T23:33:27.488ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33502025-01-16T23:33:27.488ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33512025-01-16T23:33:27.488ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
33522025-01-16T23:33:27.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33532025-01-16T23:33:27.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33542025-01-16T23:33:27.490ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
33552025-01-16T23:33:27.490ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ed15a9e-2cc8-4531-8e4b-c07791f10b19", "content-length": "2", "date": "Thu, 16 Jan 2025 23:33:26 GMT"} })
33562025-01-16T23:33:27.490ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
33572025-01-16T23:33:27.490ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1b656e1-862c-448d-b6e4-306193d448f1", "content-length": "52", "date": "Thu, 16 Jan 2025 23:33:26 GMT"} })
33582025-01-16T23:33:27.490ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
33592025-01-16T23:33:27.490ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33602025-01-16T23:33:27.530ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
33612025-01-16T23:33:27.530ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ad3cfd4-0ae0-4cb7-b7fe-e123b7ec39d6", "content-length": "691", "date": "Thu, 16 Jan 2025 23:33:27 GMT"} })
33622025-01-16T23:33:27.530ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
33632025-01-16T23:33:27.530ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
33642025-01-16T23:33:27.530ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
33652025-01-16T23:33:27.531ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 530.879076ms iteration = 19 status = {}
33662025-01-16T23:33:27.624ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "212f6cbd-c93e-4838-b65f-0f67cac1accb", "date": "Thu, 16 Jan 2025 23:33:27 GMT"} })
33672025-01-16T23:33:27.624ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
33682025-01-16T23:33:27.625ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33692025-01-16T23:33:27.625ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4afd110-6735-47a5-998a-4d8299e99f6e", "content-length": "682", "date": "Thu, 16 Jan 2025 23:33:27 GMT"} })
33702025-01-16T23:33:27.625ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33712025-01-16T23:33:27.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33722025-01-16T23:33:27.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33732025-01-16T23:33:27.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33742025-01-16T23:33:27.631ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33752025-01-16T23:33:27.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33762025-01-16T23:33:27.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33772025-01-16T23:33:27.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33782025-01-16T23:33:27.642ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 640.911689ms iteration = 19 status = {}
33792025-01-16T23:33:28.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ac8d08ec-80f6-4cf7-883d-f796a5d1834f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33802025-01-16T23:33:28.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ac8d08ec-80f6-4cf7-883d-f796a5d1834f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33812025-01-16T23:33:28.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ac8d08ec-80f6-4cf7-883d-f796a5d1834f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33822025-01-16T23:33:29.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 57d977da-08c4-43e5-a6db-b726710b2f82 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33832025-01-16T23:33:29.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 57d977da-08c4-43e5-a6db-b726710b2f82 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33842025-01-16T23:33:29.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 57d977da-08c4-43e5-a6db-b726710b2f82 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33852025-01-16T23:33:30.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f59174f2-78ff-44da-8e30-ffa4130be156 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33862025-01-16T23:33:30.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f59174f2-78ff-44da-8e30-ffa4130be156 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33872025-01-16T23:33:30.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f59174f2-78ff-44da-8e30-ffa4130be156 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33882025-01-16T23:33:31.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7f8c8951-5f24-4e87-9a4c-cfb688e69da4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33892025-01-16T23:33:31.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7f8c8951-5f24-4e87-9a4c-cfb688e69da4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33902025-01-16T23:33:31.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7f8c8951-5f24-4e87-9a4c-cfb688e69da4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33912025-01-16T23:33:32.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f093b07c-87ea-43bc-935d-c8d3c7d118ee roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33922025-01-16T23:33:32.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f093b07c-87ea-43bc-935d-c8d3c7d118ee resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33932025-01-16T23:33:32.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f093b07c-87ea-43bc-935d-c8d3c7d118ee response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33942025-01-16T23:33:33.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5853dffe-95ce-40c1-b865-7ff69bbb544a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33952025-01-16T23:33:33.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5853dffe-95ce-40c1-b865-7ff69bbb544a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33962025-01-16T23:33:33.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5853dffe-95ce-40c1-b865-7ff69bbb544a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33972025-01-16T23:33:34.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8e878a3e-6e87-46cc-b412-93feb5ab03be roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33982025-01-16T23:33:34.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8e878a3e-6e87-46cc-b412-93feb5ab03be resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
33992025-01-16T23:33:34.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8e878a3e-6e87-46cc-b412-93feb5ab03be response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34002025-01-16T23:33:35.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 004db816-7cd3-439f-8ab6-653b71fc848a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34012025-01-16T23:33:35.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 004db816-7cd3-439f-8ab6-653b71fc848a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34022025-01-16T23:33:35.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 004db816-7cd3-439f-8ab6-653b71fc848a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34032025-01-16T23:33:35.732ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 432 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = fee18a66-9899-435c-9f7f-4c67c37986fa response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
34042025-01-16T23:33:36.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 61740aea-2a8f-4da0-833c-a2d180ccb4f9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34052025-01-16T23:33:36.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 61740aea-2a8f-4da0-833c-a2d180ccb4f9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34062025-01-16T23:33:36.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 61740aea-2a8f-4da0-833c-a2d180ccb4f9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34072025-01-16T23:33:37.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
34082025-01-16T23:33:37.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34092025-01-16T23:33:37.000ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
34102025-01-16T23:33:37.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34112025-01-16T23:33:37.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34122025-01-16T23:33:37.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34132025-01-16T23:33:37.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34142025-01-16T23:33:37.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34152025-01-16T23:33:37.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34162025-01-16T23:33:37.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34172025-01-16T23:33:37.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34182025-01-16T23:33:37.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34192025-01-16T23:33:37.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34202025-01-16T23:33:37.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34212025-01-16T23:33:37.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34222025-01-16T23:33:37.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
34232025-01-16T23:33:37.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34242025-01-16T23:33:37.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34252025-01-16T23:33:37.050ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
34262025-01-16T23:33:37.050ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.320357ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
34272025-01-16T23:33:37.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.265088ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34282025-01-16T23:33:37.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 77ba46ba-6279-4632-8b5a-f45a250975e1 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34292025-01-16T23:33:37.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 77ba46ba-6279-4632-8b5a-f45a250975e1 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34302025-01-16T23:33:37.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1818 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 77ba46ba-6279-4632-8b5a-f45a250975e1 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34312025-01-16T23:33:38.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7906125f-2111-40af-9cf3-b3b9b2572eaa roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34322025-01-16T23:33:38.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7906125f-2111-40af-9cf3-b3b9b2572eaa resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34332025-01-16T23:33:38.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7906125f-2111-40af-9cf3-b3b9b2572eaa response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34342025-01-16T23:33:39.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c9385688-4bd6-487c-9b83-d6f8f1c946e1 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34352025-01-16T23:33:39.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c9385688-4bd6-487c-9b83-d6f8f1c946e1 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34362025-01-16T23:33:39.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c9385688-4bd6-487c-9b83-d6f8f1c946e1 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34372025-01-16T23:33:40.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = df4a1a40-0b96-45b4-ab19-ccadcdee11b9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34382025-01-16T23:33:40.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = df4a1a40-0b96-45b4-ab19-ccadcdee11b9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34392025-01-16T23:33:40.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = df4a1a40-0b96-45b4-ab19-ccadcdee11b9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34402025-01-16T23:33:41.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 20ca5505-ce77-493f-b829-78fe8dd61a68 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34412025-01-16T23:33:41.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 20ca5505-ce77-493f-b829-78fe8dd61a68 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34422025-01-16T23:33:41.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 20ca5505-ce77-493f-b829-78fe8dd61a68 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34432025-01-16T23:33:42.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1e737fe1-479a-48fd-b568-8ca5b3e63c91 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34442025-01-16T23:33:42.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1e737fe1-479a-48fd-b568-8ca5b3e63c91 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34452025-01-16T23:33:42.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1e737fe1-479a-48fd-b568-8ca5b3e63c91 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34462025-01-16T23:33:43.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e8fced42-9ab5-4570-bb1e-00e6b2ff0606 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34472025-01-16T23:33:43.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e8fced42-9ab5-4570-bb1e-00e6b2ff0606 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34482025-01-16T23:33:43.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e8fced42-9ab5-4570-bb1e-00e6b2ff0606 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34492025-01-16T23:33:44.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 341b6e65-5733-46f3-9930-f175c260737a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34502025-01-16T23:33:44.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 341b6e65-5733-46f3-9930-f175c260737a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34512025-01-16T23:33:44.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 341b6e65-5733-46f3-9930-f175c260737a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34522025-01-16T23:33:45.731ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 545 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 4b958d6a-01e5-4b0b-ac4f-620df96ccfaa response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
34532025-01-16T23:33:45.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d7252827-9f32-4e2f-b8ce-fd97dbb5cc1d roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34542025-01-16T23:33:45.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d7252827-9f32-4e2f-b8ce-fd97dbb5cc1d resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34552025-01-16T23:33:45.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d7252827-9f32-4e2f-b8ce-fd97dbb5cc1d response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34562025-01-16T23:33:46.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e05ea011-dc39-4225-af30-44fe8a41563a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34572025-01-16T23:33:46.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e05ea011-dc39-4225-af30-44fe8a41563a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34582025-01-16T23:33:46.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e05ea011-dc39-4225-af30-44fe8a41563a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34592025-01-16T23:33:47.000ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
34602025-01-16T23:33:47.000ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34612025-01-16T23:33:47.000ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
34622025-01-16T23:33:47.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34632025-01-16T23:33:47.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34642025-01-16T23:33:47.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34652025-01-16T23:33:47.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34662025-01-16T23:33:47.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34672025-01-16T23:33:47.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34682025-01-16T23:33:47.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34692025-01-16T23:33:47.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34702025-01-16T23:33:47.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34712025-01-16T23:33:47.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34722025-01-16T23:33:47.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34732025-01-16T23:33:47.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34742025-01-16T23:33:47.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
34752025-01-16T23:33:47.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34762025-01-16T23:33:47.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34772025-01-16T23:33:47.027ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
34782025-01-16T23:33:47.027ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.428018ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
34792025-01-16T23:33:47.039ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.303335ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34802025-01-16T23:33:47.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 81da4e7a-45ec-432f-a463-9f749ce76e4a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34812025-01-16T23:33:47.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 81da4e7a-45ec-432f-a463-9f749ce76e4a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34822025-01-16T23:33:47.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 81da4e7a-45ec-432f-a463-9f749ce76e4a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34832025-01-16T23:33:48.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 78438403-ef20-4440-af13-ce1f2c7218e0 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34842025-01-16T23:33:48.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 78438403-ef20-4440-af13-ce1f2c7218e0 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34852025-01-16T23:33:48.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 78438403-ef20-4440-af13-ce1f2c7218e0 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34862025-01-16T23:33:49.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ea26a9e9-15f1-4d6f-9409-7e7abe50c709 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34872025-01-16T23:33:49.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ea26a9e9-15f1-4d6f-9409-7e7abe50c709 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34882025-01-16T23:33:49.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ea26a9e9-15f1-4d6f-9409-7e7abe50c709 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34892025-01-16T23:33:50.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = b023151d-3263-49cd-bfc6-74c496767610 roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
34902025-01-16T23:33:50.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = b023151d-3263-49cd-bfc6-74c496767610 resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
34912025-01-16T23:33:50.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = b023151d-3263-49cd-bfc6-74c496767610 response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
34922025-01-16T23:33:50.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = a0a156f1-d207-4583-a7d3-dfe47401ccac roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
34932025-01-16T23:33:50.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = a0a156f1-d207-4583-a7d3-dfe47401ccac resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
34942025-01-16T23:33:50.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = a0a156f1-d207-4583-a7d3-dfe47401ccac response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
34952025-01-16T23:33:51.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fea070e3-bd7d-4a48-8486-93f864c3db3b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34962025-01-16T23:33:51.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fea070e3-bd7d-4a48-8486-93f864c3db3b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34972025-01-16T23:33:51.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fea070e3-bd7d-4a48-8486-93f864c3db3b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34982025-01-16T23:33:52.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dfa70fae-2d9d-4d7b-8968-84a26c5763b0 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
34992025-01-16T23:33:52.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dfa70fae-2d9d-4d7b-8968-84a26c5763b0 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
35002025-01-16T23:33:52.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dfa70fae-2d9d-4d7b-8968-84a26c5763b0 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
35012025-01-16T23:33:53.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3c64ff9f-a117-40b7-9d58-170258011c0f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
35022025-01-16T23:33:53.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3c64ff9f-a117-40b7-9d58-170258011c0f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
35032025-01-16T23:33:53.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2712 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3c64ff9f-a117-40b7-9d58-170258011c0f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
35042025-01-16T23:33:54.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3b29e4a7-3a53-440d-ab25-4b24fb98c825 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
35052025-01-16T23:33:54.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3b29e4a7-3a53-440d-ab25-4b24fb98c825 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
35062025-01-16T23:33:54.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3b29e4a7-3a53-440d-ab25-4b24fb98c825 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
35072025-01-16T23:33:55.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 577e7721-322d-476f-b9d9-66a28b3f2c71 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
35082025-01-16T23:33:55.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 577e7721-322d-476f-b9d9-66a28b3f2c71 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
35092025-01-16T23:33:55.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 577e7721-322d-476f-b9d9-66a28b3f2c71 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
35102025-01-16T23:33:55.732ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 478 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 10e118a2-e5d9-49ee-bc52-d739d687be76 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
35112025-01-16T23:33:56.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 91c47c44-5bca-4503-86b3-a94242382d29 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
35122025-01-16T23:33:56.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 91c47c44-5bca-4503-86b3-a94242382d29 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
35132025-01-16T23:33:56.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 91c47c44-5bca-4503-86b3-a94242382d29 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
35142025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
35152025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35162025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
35172025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35182025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
35192025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
35202025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35212025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35222025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
35232025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
35242025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35252025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
35262025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
35272025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
35282025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35292025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35302025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35312025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
35322025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
35332025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35342025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
35352025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35362025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35372025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35382025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
35392025-01-16T23:33:57.001ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35402025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35412025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
35422025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35432025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35442025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35452025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35462025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35472025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35482025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35492025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35502025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35512025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35522025-01-16T23:33:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35532025-01-16T23:33:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35542025-01-16T23:33:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35552025-01-16T23:33:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35562025-01-16T23:33:57.002ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
35572025-01-16T23:33:57.002ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
35582025-01-16T23:33:57.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35592025-01-16T23:33:57.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35602025-01-16T23:33:57.002ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
35612025-01-16T23:33:57.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
35622025-01-16T23:33:57.002ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
35632025-01-16T23:33:57.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35642025-01-16T23:33:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35652025-01-16T23:33:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35662025-01-16T23:33:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35672025-01-16T23:33:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35682025-01-16T23:33:57.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35692025-01-16T23:33:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35702025-01-16T23:33:57.004ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35712025-01-16T23:33:57.004ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.308473ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35722025-01-16T23:33:57.005ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1545, tv_nsec: 320798875 } })
35732025-01-16T23:33:57.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35742025-01-16T23:33:57.005ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
35752025-01-16T23:33:57.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
35762025-01-16T23:33:57.006ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35772025-01-16T23:33:57.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35782025-01-16T23:33:57.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35792025-01-16T23:33:57.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35802025-01-16T23:33:57.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35812025-01-16T23:33:57.008ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35822025-01-16T23:33:57.009ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1545, tv_nsec: 325342073 } })
35832025-01-16T23:33:57.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35842025-01-16T23:33:57.010ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
35852025-01-16T23:33:57.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35862025-01-16T23:33:57.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35872025-01-16T23:33:57.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35882025-01-16T23:33:57.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35892025-01-16T23:33:57.012ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35902025-01-16T23:33:57.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35912025-01-16T23:33:57.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35922025-01-16T23:33:57.012ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35932025-01-16T23:33:57.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35942025-01-16T23:33:57.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35952025-01-16T23:33:57.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35962025-01-16T23:33:57.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35972025-01-16T23:33:57.015ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35982025-01-16T23:33:57.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35992025-01-16T23:33:57.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.694423ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
36002025-01-16T23:33:57.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36012025-01-16T23:33:57.018ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36022025-01-16T23:33:57.018ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1545, tv_nsec: 334325405 } })
36032025-01-16T23:33:57.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36042025-01-16T23:33:57.019ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
36052025-01-16T23:33:57.019ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36062025-01-16T23:33:57.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36072025-01-16T23:33:57.021ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36082025-01-16T23:33:57.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36092025-01-16T23:33:57.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36102025-01-16T23:33:57.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36112025-01-16T23:33:57.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36122025-01-16T23:33:57.047ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36132025-01-16T23:33:57.047ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36142025-01-16T23:33:57.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36152025-01-16T23:33:57.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36162025-01-16T23:33:57.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36172025-01-16T23:33:57.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.450279ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
36182025-01-16T23:33:57.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36192025-01-16T23:33:57.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36202025-01-16T23:33:57.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36212025-01-16T23:33:57.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36222025-01-16T23:33:57.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36232025-01-16T23:33:57.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36242025-01-16T23:33:57.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36252025-01-16T23:33:57.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36262025-01-16T23:33:57.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36272025-01-16T23:33:57.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36282025-01-16T23:33:57.059ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36292025-01-16T23:33:57.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36302025-01-16T23:33:57.060ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36312025-01-16T23:33:57.060ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.908171ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36322025-01-16T23:33:57.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
36332025-01-16T23:33:57.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36342025-01-16T23:33:57.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36352025-01-16T23:33:57.061ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.443211ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36362025-01-16T23:33:57.063ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36372025-01-16T23:33:57.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36382025-01-16T23:33:57.065ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36392025-01-16T23:33:57.065ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36402025-01-16T23:33:57.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36412025-01-16T23:33:57.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
36422025-01-16T23:33:57.067ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36432025-01-16T23:33:57.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36442025-01-16T23:33:57.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36452025-01-16T23:33:57.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36462025-01-16T23:33:57.072ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36472025-01-16T23:33:57.073ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
36482025-01-16T23:33:57.073ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.029393ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
36492025-01-16T23:33:57.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36502025-01-16T23:33:57.074ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36512025-01-16T23:33:57.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36522025-01-16T23:33:57.081ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
36532025-01-16T23:33:57.081ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36542025-01-16T23:33:57.081ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6265710b-fb8f-4ac5-9828-4ed9a7766eb4", "content-length": "26", "date": "Thu, 16 Jan 2025 23:33:56 GMT"} })
36552025-01-16T23:33:57.081ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36562025-01-16T23:33:57.083ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36572025-01-16T23:33:57.085ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36582025-01-16T23:33:57.085ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36592025-01-16T23:33:57.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36602025-01-16T23:33:57.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36612025-01-16T23:33:57.089ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
36622025-01-16T23:33:57.089ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36632025-01-16T23:33:57.089ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff2d8f0f-8142-4440-a661-e48665f1797e", "content-length": "26", "date": "Thu, 16 Jan 2025 23:33:56 GMT"} })
36642025-01-16T23:33:57.089ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36652025-01-16T23:33:57.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.566331ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36662025-01-16T23:33:57.092ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36672025-01-16T23:33:57.093ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 90.682991ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36682025-01-16T23:33:57.093ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36692025-01-16T23:33:57.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
36702025-01-16T23:33:57.096ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36712025-01-16T23:33:57.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36722025-01-16T23:33:57.098ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.229918ms iteration = 20 status = 0
36732025-01-16T23:33:57.099ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
36742025-01-16T23:33:57.099ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 98.557743ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
36752025-01-16T23:33:57.107ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36762025-01-16T23:33:57.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36772025-01-16T23:33:57.113ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
36782025-01-16T23:33:57.113ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36792025-01-16T23:33:57.114ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff5068c8-1c43-4272-9ff7-6c0eaa6a8b93", "content-length": "26", "date": "Thu, 16 Jan 2025 23:33:56 GMT"} })
36802025-01-16T23:33:57.114ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36812025-01-16T23:33:57.115ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
36822025-01-16T23:33:57.115ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 114.514279ms iteration = 22 status = {"physical_disks_added":0}
36832025-01-16T23:33:57.120ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36842025-01-16T23:33:57.120ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36852025-01-16T23:33:57.120ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.881473ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36862025-01-16T23:33:57.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bf287f19-0a2e-4cc4-b941-e859dc953012 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
36872025-01-16T23:33:57.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bf287f19-0a2e-4cc4-b941-e859dc953012 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
36882025-01-16T23:33:57.164ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36892025-01-16T23:33:57.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36902025-01-16T23:33:57.177ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36912025-01-16T23:33:57.177ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "22664d41-0c2b-4b49-86b4-e5f7854c7875", "content-length": "1", "date": "Thu, 16 Jan 2025 23:33:56 GMT"} })
36922025-01-16T23:33:57.179ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36932025-01-16T23:33:57.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36942025-01-16T23:33:57.187ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 186.016483ms iteration = 20 status = {}
36952025-01-16T23:33:57.191ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36962025-01-16T23:33:57.191ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36972025-01-16T23:33:57.191ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d04e231f-9e2c-44d0-8703-cb07de72e7ba", "content-length": "372", "date": "Thu, 16 Jan 2025 23:33:56 GMT"} })
36982025-01-16T23:33:57.191ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36992025-01-16T23:33:57.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37002025-01-16T23:33:57.193ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37012025-01-16T23:33:57.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bf287f19-0a2e-4cc4-b941-e859dc953012 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37022025-01-16T23:33:57.194ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 193.304623ms iteration = 20 status = null
37032025-01-16T23:33:57.195ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37042025-01-16T23:33:57.195ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37052025-01-16T23:33:57.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37062025-01-16T23:33:57.211ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
37072025-01-16T23:33:57.211ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37082025-01-16T23:33:57.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 234.238479ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
37092025-01-16T23:33:57.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37102025-01-16T23:33:57.242ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37112025-01-16T23:33:57.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37122025-01-16T23:33:57.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37132025-01-16T23:33:57.267ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37142025-01-16T23:33:57.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37152025-01-16T23:33:57.269ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
37162025-01-16T23:33:57.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37172025-01-16T23:33:57.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37182025-01-16T23:33:57.279ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37192025-01-16T23:33:57.280ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4acfd13-56c1-4d9b-9f02-45e5dd49d0a7", "content-length": "134", "date": "Thu, 16 Jan 2025 23:33:56 GMT"} })
37202025-01-16T23:33:57.280ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37212025-01-16T23:33:57.280ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
37222025-01-16T23:33:57.280ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37232025-01-16T23:33:57.280ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37242025-01-16T23:33:57.280ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37252025-01-16T23:33:57.280ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37262025-01-16T23:33:57.280ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37272025-01-16T23:33:57.280ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37282025-01-16T23:33:57.280ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37292025-01-16T23:33:57.280ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37302025-01-16T23:33:57.280ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
37312025-01-16T23:33:57.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37322025-01-16T23:33:57.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37332025-01-16T23:33:57.283ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37342025-01-16T23:33:57.283ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e83f3062-e2d8-43f4-b56e-e949063b2cc9", "content-length": "2", "date": "Thu, 16 Jan 2025 23:33:56 GMT"} })
37352025-01-16T23:33:57.283ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37362025-01-16T23:33:57.283ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ef1683e-104f-4335-90e0-44168c34b170", "content-length": "52", "date": "Thu, 16 Jan 2025 23:33:56 GMT"} })
37372025-01-16T23:33:57.283ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
37382025-01-16T23:33:57.283ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37392025-01-16T23:33:57.301ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9b8fae9d-a9ab-43ac-a5ee-65a62d1a9675", "date": "Thu, 16 Jan 2025 23:33:57 GMT"} })
37402025-01-16T23:33:57.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37412025-01-16T23:33:57.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37422025-01-16T23:33:57.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37432025-01-16T23:33:57.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37442025-01-16T23:33:57.306ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37452025-01-16T23:33:57.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37462025-01-16T23:33:57.335ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37472025-01-16T23:33:57.335ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5be643b-2bd0-4aca-aba7-9eb11424382b", "content-length": "691", "date": "Thu, 16 Jan 2025 23:33:56 GMT"} })
37482025-01-16T23:33:57.335ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37492025-01-16T23:33:57.335ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37502025-01-16T23:33:57.335ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37512025-01-16T23:33:57.337ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 336.065264ms iteration = 20 status = {}
37522025-01-16T23:33:57.338ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37532025-01-16T23:33:57.338ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37542025-01-16T23:33:57.339ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b45e8c99-195f-4469-bb91-3dc8a0b91110", "date": "Thu, 16 Jan 2025 23:33:56 GMT"} })
37552025-01-16T23:33:57.340ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 339.46522ms iteration = 20 status = {}
37562025-01-16T23:33:57.398ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9b604723-3a09-4455-925f-84e0cf2f28a3", "date": "Thu, 16 Jan 2025 23:33:57 GMT"} })
37572025-01-16T23:33:57.398ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
37582025-01-16T23:33:57.398ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37592025-01-16T23:33:57.398ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "64181a88-2b07-434d-8fc3-7d8f30042774", "content-length": "682", "date": "Thu, 16 Jan 2025 23:33:56 GMT"} })
37602025-01-16T23:33:57.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37612025-01-16T23:33:57.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37622025-01-16T23:33:57.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37632025-01-16T23:33:57.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37642025-01-16T23:33:57.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37652025-01-16T23:33:57.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37662025-01-16T23:33:57.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37672025-01-16T23:33:57.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37682025-01-16T23:33:57.419ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 417.700342ms iteration = 20 status = {}
37692025-01-16T23:33:58.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e8aa22bd-5f59-4a7d-b223-064ade152f31 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37702025-01-16T23:33:58.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e8aa22bd-5f59-4a7d-b223-064ade152f31 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37712025-01-16T23:33:58.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e8aa22bd-5f59-4a7d-b223-064ade152f31 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37722025-01-16T23:33:59.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f5ab8f2d-0146-4416-ad02-d5b196e1d7b4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37732025-01-16T23:33:59.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f5ab8f2d-0146-4416-ad02-d5b196e1d7b4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37742025-01-16T23:33:59.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f5ab8f2d-0146-4416-ad02-d5b196e1d7b4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37752025-01-16T23:34:00.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8519f350-537a-4e8f-a263-eb5074897ab9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37762025-01-16T23:34:00.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8519f350-537a-4e8f-a263-eb5074897ab9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37772025-01-16T23:34:00.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8519f350-537a-4e8f-a263-eb5074897ab9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37782025-01-16T23:34:01.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 02f567d6-9ec6-4924-8d72-13ae49454016 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37792025-01-16T23:34:01.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 02f567d6-9ec6-4924-8d72-13ae49454016 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37802025-01-16T23:34:01.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 02f567d6-9ec6-4924-8d72-13ae49454016 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37812025-01-16T23:34:02.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ad244eb3-8173-4960-9a38-6404edb9204b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37822025-01-16T23:34:02.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ad244eb3-8173-4960-9a38-6404edb9204b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37832025-01-16T23:34:02.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ad244eb3-8173-4960-9a38-6404edb9204b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37842025-01-16T23:34:03.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c3f8e8a1-4d0b-43d6-afa6-db580eb845bd roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37852025-01-16T23:34:03.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c3f8e8a1-4d0b-43d6-afa6-db580eb845bd resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37862025-01-16T23:34:03.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c3f8e8a1-4d0b-43d6-afa6-db580eb845bd response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37872025-01-16T23:34:04.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 21bda90f-7cb1-4392-bde4-742a501d28a9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37882025-01-16T23:34:04.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 21bda90f-7cb1-4392-bde4-742a501d28a9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37892025-01-16T23:34:04.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1692 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 21bda90f-7cb1-4392-bde4-742a501d28a9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37902025-01-16T23:34:05.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dd608d61-4e13-4589-98b1-f9d855b189b2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37912025-01-16T23:34:05.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dd608d61-4e13-4589-98b1-f9d855b189b2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37922025-01-16T23:34:05.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dd608d61-4e13-4589-98b1-f9d855b189b2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37932025-01-16T23:34:05.733ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 526 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 8e288a26-6a3a-4018-84a9-9af37e23b700 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
37942025-01-16T23:34:06.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3106699e-214b-4e24-99b6-d606b630f59b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37952025-01-16T23:34:06.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3106699e-214b-4e24-99b6-d606b630f59b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37962025-01-16T23:34:06.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3106699e-214b-4e24-99b6-d606b630f59b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
37972025-01-16T23:34:07.001ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
37982025-01-16T23:34:07.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37992025-01-16T23:34:07.001ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
38002025-01-16T23:34:07.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38012025-01-16T23:34:07.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38022025-01-16T23:34:07.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38032025-01-16T23:34:07.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38042025-01-16T23:34:07.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38052025-01-16T23:34:07.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38062025-01-16T23:34:07.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38072025-01-16T23:34:07.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38082025-01-16T23:34:07.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38092025-01-16T23:34:07.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38102025-01-16T23:34:07.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38112025-01-16T23:34:07.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38122025-01-16T23:34:07.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
38132025-01-16T23:34:07.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38142025-01-16T23:34:07.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38152025-01-16T23:34:07.052ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
38162025-01-16T23:34:07.052ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.570562ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
38172025-01-16T23:34:07.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.447933ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38182025-01-16T23:34:07.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ecf3adb7-3c94-4683-9e4a-601eba8dca7a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38192025-01-16T23:34:07.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ecf3adb7-3c94-4683-9e4a-601eba8dca7a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38202025-01-16T23:34:07.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ecf3adb7-3c94-4683-9e4a-601eba8dca7a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38212025-01-16T23:34:08.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d84e323c-131f-411c-b42e-313304cd80eb roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38222025-01-16T23:34:08.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d84e323c-131f-411c-b42e-313304cd80eb resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38232025-01-16T23:34:08.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d84e323c-131f-411c-b42e-313304cd80eb response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38242025-01-16T23:34:09.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4735dedf-a980-4d2f-9872-724c91dedb53 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38252025-01-16T23:34:09.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4735dedf-a980-4d2f-9872-724c91dedb53 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38262025-01-16T23:34:09.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4735dedf-a980-4d2f-9872-724c91dedb53 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38272025-01-16T23:34:10.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c3341a87-6563-4d0e-838a-a523656a95d0 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38282025-01-16T23:34:10.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c3341a87-6563-4d0e-838a-a523656a95d0 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38292025-01-16T23:34:10.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c3341a87-6563-4d0e-838a-a523656a95d0 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38302025-01-16T23:34:11.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dd10bfde-2840-433f-9a87-eaf42cce29d9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38312025-01-16T23:34:11.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dd10bfde-2840-433f-9a87-eaf42cce29d9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38322025-01-16T23:34:11.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dd10bfde-2840-433f-9a87-eaf42cce29d9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38332025-01-16T23:34:12.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 559686a4-9990-40df-a82f-ac5300b25318 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38342025-01-16T23:34:12.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 559686a4-9990-40df-a82f-ac5300b25318 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38352025-01-16T23:34:12.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 559686a4-9990-40df-a82f-ac5300b25318 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38362025-01-16T23:34:13.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7ab71bbe-5e2c-40f1-acea-caaaf5c197f4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38372025-01-16T23:34:13.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7ab71bbe-5e2c-40f1-acea-caaaf5c197f4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38382025-01-16T23:34:13.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7ab71bbe-5e2c-40f1-acea-caaaf5c197f4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38392025-01-16T23:34:14.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5663fbce-03f2-4477-a280-855492308813 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38402025-01-16T23:34:14.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5663fbce-03f2-4477-a280-855492308813 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38412025-01-16T23:34:14.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5663fbce-03f2-4477-a280-855492308813 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38422025-01-16T23:34:15.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bd4edb3c-2135-4589-9d7a-9e4dc13a84c2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38432025-01-16T23:34:15.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bd4edb3c-2135-4589-9d7a-9e4dc13a84c2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38442025-01-16T23:34:15.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bd4edb3c-2135-4589-9d7a-9e4dc13a84c2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38452025-01-16T23:34:15.733ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 630 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = d724091e-4241-4061-9456-ff1644000f48 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
38462025-01-16T23:34:16.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bd94e424-c946-4ea8-9d29-1fe6996912f0 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38472025-01-16T23:34:16.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bd94e424-c946-4ea8-9d29-1fe6996912f0 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38482025-01-16T23:34:16.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bd94e424-c946-4ea8-9d29-1fe6996912f0 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38492025-01-16T23:34:17.001ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
38502025-01-16T23:34:17.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38512025-01-16T23:34:17.001ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
38522025-01-16T23:34:17.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38532025-01-16T23:34:17.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38542025-01-16T23:34:17.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38552025-01-16T23:34:17.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38562025-01-16T23:34:17.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38572025-01-16T23:34:17.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38582025-01-16T23:34:17.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38592025-01-16T23:34:17.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38602025-01-16T23:34:17.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38612025-01-16T23:34:17.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38622025-01-16T23:34:17.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38632025-01-16T23:34:17.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38642025-01-16T23:34:17.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
38652025-01-16T23:34:17.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38662025-01-16T23:34:17.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38672025-01-16T23:34:17.028ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
38682025-01-16T23:34:17.028ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.09218ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
38692025-01-16T23:34:17.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.283037ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38702025-01-16T23:34:17.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b2542bbe-1b1a-49f1-95a6-d79c4dbc55ea roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38712025-01-16T23:34:17.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b2542bbe-1b1a-49f1-95a6-d79c4dbc55ea resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38722025-01-16T23:34:17.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b2542bbe-1b1a-49f1-95a6-d79c4dbc55ea response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38732025-01-16T23:34:18.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0df65053-5e10-49ea-825b-98ab5dd7b8cd roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38742025-01-16T23:34:18.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0df65053-5e10-49ea-825b-98ab5dd7b8cd resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38752025-01-16T23:34:18.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0df65053-5e10-49ea-825b-98ab5dd7b8cd response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38762025-01-16T23:34:19.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0ffa41c7-f525-4843-8b00-10ce3da69152 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38772025-01-16T23:34:19.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0ffa41c7-f525-4843-8b00-10ce3da69152 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38782025-01-16T23:34:19.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0ffa41c7-f525-4843-8b00-10ce3da69152 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38792025-01-16T23:34:20.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3bc85c56-589c-48ef-a344-e5c179e74c07 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38802025-01-16T23:34:20.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3bc85c56-589c-48ef-a344-e5c179e74c07 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38812025-01-16T23:34:20.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3bc85c56-589c-48ef-a344-e5c179e74c07 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38822025-01-16T23:34:21.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5db2631a-5e51-4af5-a8e6-a6915edec05e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38832025-01-16T23:34:21.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5db2631a-5e51-4af5-a8e6-a6915edec05e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38842025-01-16T23:34:21.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5db2631a-5e51-4af5-a8e6-a6915edec05e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38852025-01-16T23:34:22.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a4d874cd-2bfc-4929-a636-38be38f9efa4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38862025-01-16T23:34:22.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a4d874cd-2bfc-4929-a636-38be38f9efa4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38872025-01-16T23:34:22.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a4d874cd-2bfc-4929-a636-38be38f9efa4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38882025-01-16T23:34:23.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aa0c7cc3-cb2f-4eb4-b481-af723030ca3d roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38892025-01-16T23:34:23.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aa0c7cc3-cb2f-4eb4-b481-af723030ca3d resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38902025-01-16T23:34:23.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aa0c7cc3-cb2f-4eb4-b481-af723030ca3d response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38912025-01-16T23:34:24.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2d7415a5-c34f-4f0d-b0d1-361da7ff5cbb roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38922025-01-16T23:34:24.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2d7415a5-c34f-4f0d-b0d1-361da7ff5cbb resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38932025-01-16T23:34:24.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2d7415a5-c34f-4f0d-b0d1-361da7ff5cbb response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38942025-01-16T23:34:25.732ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 486 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = b9a87685-af84-4884-ad9a-d72ee5af2525 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
38952025-01-16T23:34:25.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 57ce7a5d-ee30-4368-8b92-f3ce3c39b190 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38962025-01-16T23:34:25.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 57ce7a5d-ee30-4368-8b92-f3ce3c39b190 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38972025-01-16T23:34:25.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 57ce7a5d-ee30-4368-8b92-f3ce3c39b190 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38982025-01-16T23:34:26.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 52ce9d78-44df-4a45-bb6b-598149beeff6 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
38992025-01-16T23:34:26.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 52ce9d78-44df-4a45-bb6b-598149beeff6 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
39002025-01-16T23:34:26.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 52ce9d78-44df-4a45-bb6b-598149beeff6 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
39012025-01-16T23:34:27.001ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
39022025-01-16T23:34:27.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39032025-01-16T23:34:27.001ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
39042025-01-16T23:34:27.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39052025-01-16T23:34:27.001ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
39062025-01-16T23:34:27.001ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
39072025-01-16T23:34:27.001ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39082025-01-16T23:34:27.001ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39092025-01-16T23:34:27.001ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
39102025-01-16T23:34:27.001ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
39112025-01-16T23:34:27.001ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca
39122025-01-16T23:34:27.001ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.58\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca"}
39132025-01-16T23:34:27.001ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
39142025-01-16T23:34:27.001ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
39152025-01-16T23:34:27.001ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
39162025-01-16T23:34:27.001ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
39172025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39182025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39192025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
39202025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39212025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
39222025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39232025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
39242025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
39252025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39262025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
39272025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
39282025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
39292025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
39302025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39312025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
39322025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
39332025-01-16T23:34:27.002ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
39342025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39352025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
39362025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39372025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39382025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
39392025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39402025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
39412025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
39422025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39432025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
39442025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39452025-01-16T23:34:27.002ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-16 23:24:27.002115568 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
39462025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
39472025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
39482025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39492025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
39502025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39512025-01-16T23:34:27.002ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39522025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39532025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
39542025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
39552025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
39562025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
39572025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39582025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
39592025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39602025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
39612025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39622025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
39632025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39642025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
39652025-01-16T23:34:27.002ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
39662025-01-16T23:34:27.002ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
39672025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
39682025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39692025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
39702025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
39712025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
39722025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
39732025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39742025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39752025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39762025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39772025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39782025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39792025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39802025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39812025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39822025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39832025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39842025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39852025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39862025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39872025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39882025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
39892025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39902025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39912025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39922025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39932025-01-16T23:34:27.002ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5c1ab32c-50b8-4564-bf29-e388b915cbdb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd10c057-8c9f-4db2-98b5-bcf5e0d536ba.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1575, tv_nsec: 318057303 } })
39942025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39952025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39962025-01-16T23:34:27.002ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
39972025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39982025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
39992025-01-16T23:34:27.002ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dc5f3810-93b6-44f1-815c-44411abf99ad.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1575, tv_nsec: 318126204 } })
40002025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
40012025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
40022025-01-16T23:34:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
40032025-01-16T23:34:27.003ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
40042025-01-16T23:34:27.003ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.463417ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
40052025-01-16T23:34:27.003ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
40062025-01-16T23:34:27.003ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.5631ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
40072025-01-16T23:34:27.005ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40082025-01-16T23:34:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40092025-01-16T23:34:27.005ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40102025-01-16T23:34:27.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40112025-01-16T23:34:27.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40122025-01-16T23:34:27.008ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.084146ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40132025-01-16T23:34:27.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40142025-01-16T23:34:27.008ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40152025-01-16T23:34:27.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40162025-01-16T23:34:27.009ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40172025-01-16T23:34:27.012ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40182025-01-16T23:34:27.012ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40192025-01-16T23:34:27.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40202025-01-16T23:34:27.013ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1575, tv_nsec: 328448472 } })
40212025-01-16T23:34:27.013ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
40222025-01-16T23:34:27.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40232025-01-16T23:34:27.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40242025-01-16T23:34:27.015ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1575, tv_nsec: 331101233 } })
40252025-01-16T23:34:27.016ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
40262025-01-16T23:34:27.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40272025-01-16T23:34:27.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40282025-01-16T23:34:27.017ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-16 23:24:27.002115568 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
40292025-01-16T23:34:27.017ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.728253ms iteration = 11 status = {"expiration":"2025-01-16T23:24:27.002115568Z","pruned":[]}
40302025-01-16T23:34:27.019ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40312025-01-16T23:34:27.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40322025-01-16T23:34:27.020ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40332025-01-16T23:34:27.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40342025-01-16T23:34:27.023ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.076125ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
40352025-01-16T23:34:27.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40362025-01-16T23:34:27.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40372025-01-16T23:34:27.048ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40382025-01-16T23:34:27.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40392025-01-16T23:34:27.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40402025-01-16T23:34:27.051ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40412025-01-16T23:34:27.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40422025-01-16T23:34:27.052ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40432025-01-16T23:34:27.052ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40442025-01-16T23:34:27.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40452025-01-16T23:34:27.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40462025-01-16T23:34:27.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40472025-01-16T23:34:27.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40482025-01-16T23:34:27.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40492025-01-16T23:34:27.056ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40502025-01-16T23:34:27.057ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40512025-01-16T23:34:27.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40522025-01-16T23:34:27.058ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40532025-01-16T23:34:27.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40542025-01-16T23:34:27.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40552025-01-16T23:34:27.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40562025-01-16T23:34:27.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40572025-01-16T23:34:27.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
40582025-01-16T23:34:27.062ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40592025-01-16T23:34:27.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40602025-01-16T23:34:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40612025-01-16T23:34:27.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40622025-01-16T23:34:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40632025-01-16T23:34:27.065ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40642025-01-16T23:34:27.065ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40652025-01-16T23:34:27.066ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40662025-01-16T23:34:27.066ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40672025-01-16T23:34:27.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40682025-01-16T23:34:27.069ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40692025-01-16T23:34:27.070ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 67.69556ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
40702025-01-16T23:34:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40712025-01-16T23:34:27.070ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40722025-01-16T23:34:27.070ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40732025-01-16T23:34:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40742025-01-16T23:34:27.070ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40752025-01-16T23:34:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40762025-01-16T23:34:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40772025-01-16T23:34:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40782025-01-16T23:34:27.071ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
40792025-01-16T23:34:27.071ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 68.76358ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
40802025-01-16T23:34:27.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40812025-01-16T23:34:27.071ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40822025-01-16T23:34:27.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40832025-01-16T23:34:27.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.671048ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
40842025-01-16T23:34:27.072ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
40852025-01-16T23:34:27.072ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
40862025-01-16T23:34:27.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40872025-01-16T23:34:27.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
40882025-01-16T23:34:27.072ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40892025-01-16T23:34:27.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40902025-01-16T23:34:27.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40912025-01-16T23:34:27.073ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40922025-01-16T23:34:27.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40932025-01-16T23:34:27.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40942025-01-16T23:34:27.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40952025-01-16T23:34:27.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40962025-01-16T23:34:27.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40972025-01-16T23:34:27.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40982025-01-16T23:34:27.076ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40992025-01-16T23:34:27.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41002025-01-16T23:34:27.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41012025-01-16T23:34:27.079ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41022025-01-16T23:34:27.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41032025-01-16T23:34:27.080ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.835564ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41042025-01-16T23:34:27.080ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
41052025-01-16T23:34:27.080ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
41062025-01-16T23:34:27.080ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 78.302644ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
41072025-01-16T23:34:27.086ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41082025-01-16T23:34:27.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41092025-01-16T23:34:27.088ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1575, tv_nsec: 403352161 } })
41102025-01-16T23:34:27.088ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
41112025-01-16T23:34:27.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41122025-01-16T23:34:27.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41132025-01-16T23:34:27.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41142025-01-16T23:34:27.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41152025-01-16T23:34:27.093ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(53d8ebdf-788a-4b0f-b75e-9d7cb91f439c, 0), (ba79a398-7b8e-439d-b9a0-f5327e7bb2c8, 0), (c859df09-146d-4d92-a88b-2f5847ced125, 0)]
41162025-01-16T23:34:27.093ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1575, tv_nsec: 409227263 } })
41172025-01-16T23:34:27.094ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41182025-01-16T23:34:27.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41192025-01-16T23:34:27.096ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41202025-01-16T23:34:27.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41212025-01-16T23:34:27.099ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41222025-01-16T23:34:27.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
41232025-01-16T23:34:27.102ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41242025-01-16T23:34:27.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41252025-01-16T23:34:27.104ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41262025-01-16T23:34:27.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41272025-01-16T23:34:27.106ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41282025-01-16T23:34:27.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41292025-01-16T23:34:27.108ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41302025-01-16T23:34:27.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
41312025-01-16T23:34:27.113ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41322025-01-16T23:34:27.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41332025-01-16T23:34:27.116ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41342025-01-16T23:34:27.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41352025-01-16T23:34:27.120ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41362025-01-16T23:34:27.120ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41372025-01-16T23:34:27.120ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41382025-01-16T23:34:27.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41392025-01-16T23:34:27.121ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41402025-01-16T23:34:27.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41412025-01-16T23:34:27.122ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41422025-01-16T23:34:27.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41432025-01-16T23:34:27.123ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
41442025-01-16T23:34:27.123ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
41452025-01-16T23:34:27.123ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 121.055925ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
41462025-01-16T23:34:27.123ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41472025-01-16T23:34:27.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41482025-01-16T23:34:27.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41492025-01-16T23:34:27.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41502025-01-16T23:34:27.125ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41512025-01-16T23:34:27.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41522025-01-16T23:34:27.127ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41532025-01-16T23:34:27.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41542025-01-16T23:34:27.128ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 125.930969ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41552025-01-16T23:34:27.128ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41562025-01-16T23:34:27.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41572025-01-16T23:34:27.129ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
41582025-01-16T23:34:27.129ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
41592025-01-16T23:34:27.129ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
41602025-01-16T23:34:27.129ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41612025-01-16T23:34:27.129ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41622025-01-16T23:34:27.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41632025-01-16T23:34:27.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41642025-01-16T23:34:27.130ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41652025-01-16T23:34:27.130ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
41662025-01-16T23:34:27.130ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
41672025-01-16T23:34:27.130ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
41682025-01-16T23:34:27.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41692025-01-16T23:34:27.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41702025-01-16T23:34:27.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41712025-01-16T23:34:27.131ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41722025-01-16T23:34:27.131ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 129.693081ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41732025-01-16T23:34:27.132ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41742025-01-16T23:34:27.133ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41752025-01-16T23:34:27.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41762025-01-16T23:34:27.134ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41772025-01-16T23:34:27.134ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41782025-01-16T23:34:27.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
41792025-01-16T23:34:27.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41802025-01-16T23:34:27.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41812025-01-16T23:34:27.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41822025-01-16T23:34:27.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
41832025-01-16T23:34:27.136ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41842025-01-16T23:34:27.136ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41852025-01-16T23:34:27.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41862025-01-16T23:34:27.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41872025-01-16T23:34:27.137ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41882025-01-16T23:34:27.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41892025-01-16T23:34:27.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41902025-01-16T23:34:27.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41912025-01-16T23:34:27.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
41922025-01-16T23:34:27.138ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41932025-01-16T23:34:27.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41942025-01-16T23:34:27.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41952025-01-16T23:34:27.138ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41962025-01-16T23:34:27.138ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41972025-01-16T23:34:27.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41982025-01-16T23:34:27.139ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41992025-01-16T23:34:27.139ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 137.708815ms iteration = 21 status = 0
42002025-01-16T23:34:27.140ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42012025-01-16T23:34:27.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42022025-01-16T23:34:27.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
42032025-01-16T23:34:27.142ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42042025-01-16T23:34:27.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
42052025-01-16T23:34:27.144ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42062025-01-16T23:34:27.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42072025-01-16T23:34:27.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42082025-01-16T23:34:27.147ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42092025-01-16T23:34:27.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42102025-01-16T23:34:27.147ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 145.546546ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42112025-01-16T23:34:27.150ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42122025-01-16T23:34:27.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42132025-01-16T23:34:27.153ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
42142025-01-16T23:34:27.153ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 151.49926ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
42152025-01-16T23:34:27.164ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
42162025-01-16T23:34:27.167ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42172025-01-16T23:34:27.167ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
42182025-01-16T23:34:27.167ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 165.426357ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
42192025-01-16T23:34:27.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 166.745922ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
42202025-01-16T23:34:27.175ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
42212025-01-16T23:34:27.175ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 172.969102ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
42222025-01-16T23:34:27.176ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42232025-01-16T23:34:27.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42242025-01-16T23:34:27.181ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
42252025-01-16T23:34:27.181ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42262025-01-16T23:34:27.182ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6b5081f-5269-4055-aec3-8ce7f58d0987", "content-length": "26", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42272025-01-16T23:34:27.182ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42282025-01-16T23:34:27.183ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
42292025-01-16T23:34:27.183ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 181.659749ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
42302025-01-16T23:34:27.184ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42312025-01-16T23:34:27.188ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42322025-01-16T23:34:27.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42332025-01-16T23:34:27.193ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
42342025-01-16T23:34:27.193ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
42352025-01-16T23:34:27.193ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42362025-01-16T23:34:27.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42372025-01-16T23:34:27.193ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-16T23:24:20.471931Z, time_modified: 2025-01-16T23:24:20.471931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }) }
42382025-01-16T23:34:27.193ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 191.471107ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]}},"default_endpoint":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
42392025-01-16T23:34:27.196ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
42402025-01-16T23:34:27.196ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 0 version = 2
42412025-01-16T23:34:27.196ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42422025-01-16T23:34:27.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42432025-01-16T23:34:27.206ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 204.473837ms iteration = 23 status = {"physical_disks_added":0}
42442025-01-16T23:34:27.261ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
42452025-01-16T23:34:27.268ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
42462025-01-16T23:34:27.268ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
42472025-01-16T23:34:27.268ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
42482025-01-16T23:34:27.268ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd69874d-008f-4473-a547-d1cbb4713aa2", "content-length": "476", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42492025-01-16T23:34:27.268ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
42502025-01-16T23:34:27.268ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "50cb4300-c3fd-4897-a65a-c5e879aed58e", "content-length": "734", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42512025-01-16T23:34:27.268ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
42522025-01-16T23:34:27.269ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "40c607ea-2796-47c0-9e19-385a2570a573", "content-length": "111", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42532025-01-16T23:34:27.269ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
42542025-01-16T23:34:27.269ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "77884406-f415-4bd6-8090-02185c3aecef", "content-length": "111", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42552025-01-16T23:34:27.269ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
42562025-01-16T23:34:27.269ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b5aca9b-32ff-42a9-b757-abfda29b45bf", "content-length": "167", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42572025-01-16T23:34:27.269ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
42582025-01-16T23:34:27.269ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "89b05c46-8cfa-4e8d-b24e-78ea5cd1e94e", "content-length": "167", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42592025-01-16T23:34:27.269ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
42602025-01-16T23:34:27.269ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c84c56f-9147-4098-b5bd-c37dd266bc53", "content-length": "175", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42612025-01-16T23:34:27.269ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
42622025-01-16T23:34:27.270ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2376381-3c02-41f8-918f-107d7838de19", "content-length": "175", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42632025-01-16T23:34:27.270ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
42642025-01-16T23:34:27.270ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1de6207a-f988-40d3-b4ea-58aab7859ee5", "content-length": "702", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42652025-01-16T23:34:27.270ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
42662025-01-16T23:34:27.270ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "62bfdcd6-14e0-42bf-aad0-2f2f420b30ba", "content-length": "727", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42672025-01-16T23:34:27.270ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
42682025-01-16T23:34:27.270ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ddf5a46-0580-4231-8a83-80e8bb97222a", "content-length": "729", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42692025-01-16T23:34:27.270ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
42702025-01-16T23:34:27.270ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "28d0b5fd-4ea8-48e5-90e1-07fcfd7577ec", "content-length": "728", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42712025-01-16T23:34:27.270ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
42722025-01-16T23:34:27.271ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1943354b-d3bd-4703-a734-eecb57bacb1c", "content-length": "722", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42732025-01-16T23:34:27.271ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
42742025-01-16T23:34:27.271ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7110399-ed6f-4bd8-8380-ed806417f685", "content-length": "109", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42752025-01-16T23:34:27.271ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
42762025-01-16T23:34:27.271ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "de96e033-2a5e-4539-98b4-32a7902124ea", "content-length": "109", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42772025-01-16T23:34:27.271ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
42782025-01-16T23:34:27.271ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "670ff9ec-34d7-478c-a959-070ee45ed547", "content-length": "169", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42792025-01-16T23:34:27.271ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
42802025-01-16T23:34:27.272ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4f77aed-4b58-47c1-94fe-a2ec0edf4bd6", "content-length": "169", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42812025-01-16T23:34:27.272ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
42822025-01-16T23:34:27.272ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fe52b18-f820-4efc-94b0-6d9dd55f1179", "content-length": "178", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42832025-01-16T23:34:27.272ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
42842025-01-16T23:34:27.272ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "faa2179e-a44c-46d5-a41b-afdc182d47a9", "content-length": "178", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42852025-01-16T23:34:27.272ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
42862025-01-16T23:34:27.272ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dee0b60d-3af9-4b0d-89fc-88c1b3d18ec0", "content-length": "702", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42872025-01-16T23:34:27.272ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
42882025-01-16T23:34:27.273ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c09b1bac-5866-46f6-8a9c-d94a12349578", "content-length": "727", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42892025-01-16T23:34:27.273ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
42902025-01-16T23:34:27.273ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8279b6a-0aff-4d91-a9e1-caac4d1421df", "content-length": "729", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42912025-01-16T23:34:27.273ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
42922025-01-16T23:34:27.273ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "684fd1e4-5604-4591-b59d-282e7c8e29e4", "content-length": "728", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42932025-01-16T23:34:27.273ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
42942025-01-16T23:34:27.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
42952025-01-16T23:34:27.283ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
42962025-01-16T23:34:27.284ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42972025-01-16T23:34:27.284ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "79aa2ac3-943a-455d-8470-fd7df4cf4a80", "content-length": "26", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
42982025-01-16T23:34:27.284ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42992025-01-16T23:34:27.286ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
43002025-01-16T23:34:27.314ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
43012025-01-16T23:34:27.314ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43022025-01-16T23:34:27.314ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4232c996-4363-472f-a679-c5e425fe5076", "content-length": "26", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
43032025-01-16T23:34:27.314ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43042025-01-16T23:34:27.316ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43052025-01-16T23:34:27.350ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
43062025-01-16T23:34:27.350ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43072025-01-16T23:34:27.350ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a005a8df-63e6-45ff-8bc0-105031700f42", "content-length": "372", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
43082025-01-16T23:34:27.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43092025-01-16T23:34:27.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43102025-01-16T23:34:27.352ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43112025-01-16T23:34:27.352ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43122025-01-16T23:34:27.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43132025-01-16T23:34:27.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43142025-01-16T23:34:27.353ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43152025-01-16T23:34:27.353ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43162025-01-16T23:34:27.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43172025-01-16T23:34:27.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43182025-01-16T23:34:27.356ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43192025-01-16T23:34:27.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43202025-01-16T23:34:27.357ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
43212025-01-16T23:34:27.358ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2aaf4f60-8bec-4494-8bad-8b7ae2c929e6", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43222025-01-16T23:34:27.358ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43232025-01-16T23:34:27.358ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43242025-01-16T23:34:27.358ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43252025-01-16T23:34:27.362ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43262025-01-16T23:34:27.362ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43272025-01-16T23:34:27.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43282025-01-16T23:34:27.363ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e47ce23b-33b7-4c30-8611-4cd866c38aad", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43292025-01-16T23:34:27.363ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43302025-01-16T23:34:27.363ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
43312025-01-16T23:34:27.363ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43322025-01-16T23:34:27.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43332025-01-16T23:34:27.364ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 1 version = 2
43342025-01-16T23:34:27.364ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
43352025-01-16T23:34:27.364ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-16 23:25:21.695734 UTC dns_group = external generation = 2
43362025-01-16T23:34:27.364ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 362.098585ms iteration = 11 status = {"generation":2}
43372025-01-16T23:34:27.365ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43382025-01-16T23:34:27.365ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 363.363008ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
43392025-01-16T23:34:27.373ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43402025-01-16T23:34:27.373ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c6c7a48-d328-4dd5-a085-c3e70d3d6f9c", "content-length": "1", "date": "Thu, 16 Jan 2025 23:34:26 GMT"} })
43412025-01-16T23:34:27.375ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43422025-01-16T23:34:27.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43432025-01-16T23:34:27.378ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 376.194405ms iteration = 21 status = null
43442025-01-16T23:34:27.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43452025-01-16T23:34:27.392ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43462025-01-16T23:34:27.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43472025-01-16T23:34:27.394ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43482025-01-16T23:34:27.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43492025-01-16T23:34:27.394ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43502025-01-16T23:34:27.394ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
43512025-01-16T23:34:27.394ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
43522025-01-16T23:34:27.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
43532025-01-16T23:34:27.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43542025-01-16T23:34:27.396ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43552025-01-16T23:34:27.397ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
43562025-01-16T23:34:27.397ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
43572025-01-16T23:34:27.397ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-16 23:25:20.756297 UTC dns_group = internal generation = 1
43582025-01-16T23:34:27.397ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 395.001066ms iteration = 11 status = {"generation":1}
43592025-01-16T23:34:27.397ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43602025-01-16T23:34:27.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43612025-01-16T23:34:27.398ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
43622025-01-16T23:34:27.398ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
43632025-01-16T23:34:27.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
43642025-01-16T23:34:27.400ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
43652025-01-16T23:34:27.400ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
43662025-01-16T23:34:27.400ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "308115eb-270d-4a2a-bd97-6a5875c3956d", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
43672025-01-16T23:34:27.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43682025-01-16T23:34:27.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43692025-01-16T23:34:27.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43702025-01-16T23:34:27.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43712025-01-16T23:34:27.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43722025-01-16T23:34:27.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43732025-01-16T23:34:27.409ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
43742025-01-16T23:34:27.409ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
43752025-01-16T23:34:27.409ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43762025-01-16T23:34:27.410ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6c2fa999-8989-4461-940d-b0e671a5b734", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
43772025-01-16T23:34:27.412ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 410.158238ms iteration = 21 status = {}
43782025-01-16T23:34:27.412ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 410.681887ms iteration = 21 status = {}
43792025-01-16T23:34:27.428ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43802025-01-16T23:34:27.431ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
43812025-01-16T23:34:27.431ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43822025-01-16T23:34:27.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43832025-01-16T23:34:27.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43842025-01-16T23:34:27.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43852025-01-16T23:34:27.439ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43862025-01-16T23:34:27.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43872025-01-16T23:34:27.440ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43882025-01-16T23:34:27.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43892025-01-16T23:34:27.443ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43902025-01-16T23:34:27.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43912025-01-16T23:34:27.445ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43922025-01-16T23:34:27.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43932025-01-16T23:34:27.446ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43942025-01-16T23:34:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43952025-01-16T23:34:27.447ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43962025-01-16T23:34:27.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43972025-01-16T23:34:27.488ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
43982025-01-16T23:34:27.489ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f0cf03bb-e6e9-40c5-8401-6a47ac6fb756", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
43992025-01-16T23:34:27.489ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44002025-01-16T23:34:27.490ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a899725b-1de8-4172-84cc-9fc2036bd21a", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44012025-01-16T23:34:27.490ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44022025-01-16T23:34:27.491ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fe15e012-5cb8-4136-9377-f0213b4b46c0", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44032025-01-16T23:34:27.491ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44042025-01-16T23:34:27.493ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44052025-01-16T23:34:27.493ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 491.253475ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
44062025-01-16T23:34:27.513ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44072025-01-16T23:34:27.513ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a592f7cc-9ca0-4b49-bd2f-b986cf9e7f5c", "content-length": "691", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
44082025-01-16T23:34:27.513ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
44092025-01-16T23:34:27.513ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
44102025-01-16T23:34:27.513ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
44112025-01-16T23:34:27.514ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44122025-01-16T23:34:27.515ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 513.221137ms iteration = 21 status = {}
44132025-01-16T23:34:27.518ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
44142025-01-16T23:34:27.518ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44152025-01-16T23:34:27.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44162025-01-16T23:34:27.520ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44172025-01-16T23:34:27.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44182025-01-16T23:34:27.531ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
44192025-01-16T23:34:27.531ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
44202025-01-16T23:34:27.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44212025-01-16T23:34:27.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44222025-01-16T23:34:27.543ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
44232025-01-16T23:34:27.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44242025-01-16T23:34:27.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44252025-01-16T23:34:27.552ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44262025-01-16T23:34:27.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44272025-01-16T23:34:27.554ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44282025-01-16T23:34:27.554ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44292025-01-16T23:34:27.554ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "94272174-2800-49d6-b2a8-a4e2f03d198a", "content-length": "134", "date": "Thu, 16 Jan 2025 23:34:26 GMT"} })
44302025-01-16T23:34:27.554ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
44312025-01-16T23:34:27.554ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
44322025-01-16T23:34:27.555ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
44332025-01-16T23:34:27.555ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44342025-01-16T23:34:27.555ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44352025-01-16T23:34:27.555ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44362025-01-16T23:34:27.555ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44372025-01-16T23:34:27.555ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44382025-01-16T23:34:27.555ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44392025-01-16T23:34:27.555ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44402025-01-16T23:34:27.555ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
44412025-01-16T23:34:27.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44422025-01-16T23:34:27.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44432025-01-16T23:34:27.557ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
44442025-01-16T23:34:27.557ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44452025-01-16T23:34:27.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44462025-01-16T23:34:27.558ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44472025-01-16T23:34:27.558ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "790f2d8d-66b1-4b42-85a6-521f96989eb3", "content-length": "2", "date": "Thu, 16 Jan 2025 23:34:26 GMT"} })
44482025-01-16T23:34:27.558ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44492025-01-16T23:34:27.558ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6eb6fd03-be54-436d-9e89-7727d58c8949", "content-length": "52", "date": "Thu, 16 Jan 2025 23:34:26 GMT"} })
44502025-01-16T23:34:27.558ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
44512025-01-16T23:34:27.558ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44522025-01-16T23:34:27.564ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 37bada54-3ac8-4367-9487-f47381e04cf6, kind: Service { id: bda5150c-3889-413e-a774-9d40d8f8536d }, name: Name("nexus-bda5150c-3889-413e-a774-9d40d8f8536d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b4d3cb4-34c8-4838-94e3-102c732f938c, kind: Service { id: 1d7f4b38-ce97-4d7c-b37c-92212a02a45f }, name: Name("nexus-1d7f4b38-ce97-4d7c-b37c-92212a02a45f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b50b269f-d32a-4af8-be28-7e03354f4d63, kind: Service { id: 1b5ada24-1ce5-4a0b-9c11-3c803e3e9270 }, name: Name("nexus-1b5ada24-1ce5-4a0b-9c11-3c803e3e9270"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: a9131c91-4ca4-491f-8265-8e221e38b9ad, kind: Service { id: dc5f3810-93b6-44f1-815c-44411abf99ad }, name: Name("external-dns-dc5f3810-93b6-44f1-815c-44411abf99ad"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 71])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a95ae8ff-aa26-4675-97b6-6b8d75e9ff0e, kind: Service { id: f4635fcc-61fc-4ff9-8203-b560522a972b }, name: Name("external-dns-f4635fcc-61fc-4ff9-8203-b560522a972b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 6])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
44532025-01-16T23:34:27.564ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44542025-01-16T23:34:27.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44552025-01-16T23:34:27.566ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44562025-01-16T23:34:27.567ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
44572025-01-16T23:34:27.567ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44582025-01-16T23:34:27.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44592025-01-16T23:34:27.569ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
44602025-01-16T23:34:27.569ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: a9131c91-4ca4-491f-8265-8e221e38b9ad, kind: Service { id: dc5f3810-93b6-44f1-815c-44411abf99ad }, name: Name("external-dns-dc5f3810-93b6-44f1-815c-44411abf99ad"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 71])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a95ae8ff-aa26-4675-97b6-6b8d75e9ff0e, kind: Service { id: f4635fcc-61fc-4ff9-8203-b560522a972b }, name: Name("external-dns-f4635fcc-61fc-4ff9-8203-b560522a972b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 6])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 37bada54-3ac8-4367-9487-f47381e04cf6, kind: Service { id: bda5150c-3889-413e-a774-9d40d8f8536d }, name: Name("nexus-bda5150c-3889-413e-a774-9d40d8f8536d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b4d3cb4-34c8-4838-94e3-102c732f938c, kind: Service { id: 1d7f4b38-ce97-4d7c-b37c-92212a02a45f }, name: Name("nexus-1d7f4b38-ce97-4d7c-b37c-92212a02a45f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b50b269f-d32a-4af8-be28-7e03354f4d63, kind: Service { id: 1b5ada24-1ce5-4a0b-9c11-3c803e3e9270 }, name: Name("nexus-1b5ada24-1ce5-4a0b-9c11-3c803e3e9270"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
44612025-01-16T23:34:27.569ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
44622025-01-16T23:34:27.724ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 198593b5-c3c6-4ef5-879a-52095a2ef511, time_created: 2025-01-16T23:25:11.806143Z, time_modified: 2025-01-16T23:25:11.806143Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 79114303-f678-43f7-aff3-a882c8c99560, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
44632025-01-16T23:34:27.724ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
44642025-01-16T23:34:27.724ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44652025-01-16T23:34:27.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44662025-01-16T23:34:27.727ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44672025-01-16T23:34:27.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44682025-01-16T23:34:27.729ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44692025-01-16T23:34:27.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
44702025-01-16T23:34:27.764ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
44712025-01-16T23:34:27.765ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "d0126b51-e31b-4bf9-9465-d0876b55b6b1", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
44722025-01-16T23:34:27.767ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
44732025-01-16T23:34:27.767ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 765.075024ms
44742025-01-16T23:34:27.767ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 765.084334ms iteration = 3 status = {}
44752025-01-16T23:34:27.780ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5269cef7-3f9d-4c41-8b37-03a836d90a4e", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
44762025-01-16T23:34:27.780ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
44772025-01-16T23:34:27.780ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44782025-01-16T23:34:27.781ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "39599b22-50a5-48da-8521-fb9e6c9974c8", "content-length": "682", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
44792025-01-16T23:34:27.781ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44802025-01-16T23:34:27.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44812025-01-16T23:34:27.784ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44822025-01-16T23:34:27.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44832025-01-16T23:34:27.788ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44842025-01-16T23:34:27.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44852025-01-16T23:34:27.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44862025-01-16T23:34:27.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44872025-01-16T23:34:27.798ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 796.368335ms iteration = 21 status = {}
44882025-01-16T23:34:27.854ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "2714c9b6-bc79-43b7-933a-799a2b67b04f", "content-length": "30796", "date": "Thu, 16 Jan 2025 23:34:27 GMT"} })
44892025-01-16T23:34:27.856ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
44902025-01-16T23:34:27.856ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
44912025-01-16T23:34:27.856ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
44922025-01-16T23:34:27.857ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44932025-01-16T23:34:27.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
44942025-01-16T23:34:27.860ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44952025-01-16T23:34:27.862ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
44962025-01-16T23:34:27.862ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44972025-01-16T23:34:27.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
44982025-01-16T23:34:27.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102be9f6-6be7-4a2e-b323-78ec704037f9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
44992025-01-16T23:34:27.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102be9f6-6be7-4a2e-b323-78ec704037f9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45002025-01-16T23:34:27.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102be9f6-6be7-4a2e-b323-78ec704037f9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45012025-01-16T23:34:28.082ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 144de330-3b56-4096-b46e-cd564ddb7c64 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
45022025-01-16T23:34:28.082ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 144de330-3b56-4096-b46e-cd564ddb7c64 time_started = 2025-01-16 23:34:27.268045 UTC
45032025-01-16T23:34:28.082ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.080142255s iteration = 3 status = {"collection_id":"144de330-3b56-4096-b46e-cd564ddb7c64","time_done":"2025-01-16 23:34:27.856256 UTC","time_started":"2025-01-16 23:34:27.268045 UTC"}
45042025-01-16T23:34:28.082ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
45052025-01-16T23:34:28.082ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45062025-01-16T23:34:28.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45072025-01-16T23:34:28.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45082025-01-16T23:34:28.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45092025-01-16T23:34:28.086ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45102025-01-16T23:34:28.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45112025-01-16T23:34:28.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45122025-01-16T23:34:28.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45132025-01-16T23:34:28.092ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45142025-01-16T23:34:28.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45152025-01-16T23:34:28.094ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45162025-01-16T23:34:28.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45172025-01-16T23:34:28.163ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 80.865313ms iteration = 24 status = {"physical_disks_added":0}
45182025-01-16T23:34:28.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6c2579b7-5125-40d1-ae9c-0e974d6dc9f8 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45192025-01-16T23:34:28.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6c2579b7-5125-40d1-ae9c-0e974d6dc9f8 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45202025-01-16T23:34:28.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6c2579b7-5125-40d1-ae9c-0e974d6dc9f8 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45212025-01-16T23:34:29.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1d42fc18-3036-4e0d-b051-61f1011c6abd roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45222025-01-16T23:34:29.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1d42fc18-3036-4e0d-b051-61f1011c6abd resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45232025-01-16T23:34:29.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1d42fc18-3036-4e0d-b051-61f1011c6abd response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45242025-01-16T23:34:31.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 80715703-119f-4af1-8ae3-5bfc17dac341 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45252025-01-16T23:34:31.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 80715703-119f-4af1-8ae3-5bfc17dac341 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45262025-01-16T23:34:31.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 80715703-119f-4af1-8ae3-5bfc17dac341 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45272025-01-16T23:34:32.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cb437edc-30a3-49e7-a494-38c526bd5904 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45282025-01-16T23:34:32.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cb437edc-30a3-49e7-a494-38c526bd5904 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45292025-01-16T23:34:32.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cb437edc-30a3-49e7-a494-38c526bd5904 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45302025-01-16T23:34:33.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c23c20bc-a159-42b7-ac2d-1240bd11dca2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45312025-01-16T23:34:33.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c23c20bc-a159-42b7-ac2d-1240bd11dca2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45322025-01-16T23:34:33.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c23c20bc-a159-42b7-ac2d-1240bd11dca2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45332025-01-16T23:34:34.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 67cd22a7-4f67-4b10-8931-1f49d9732a95 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45342025-01-16T23:34:34.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 67cd22a7-4f67-4b10-8931-1f49d9732a95 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45352025-01-16T23:34:34.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 67cd22a7-4f67-4b10-8931-1f49d9732a95 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45362025-01-16T23:34:35.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a72ca245-3219-42ab-b6a3-38b5bb8f612f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45372025-01-16T23:34:35.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a72ca245-3219-42ab-b6a3-38b5bb8f612f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45382025-01-16T23:34:35.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a72ca245-3219-42ab-b6a3-38b5bb8f612f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45392025-01-16T23:34:35.732ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 626 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 6ab1c6fa-1e99-464b-9502-8ddf1d784b68 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
45402025-01-16T23:34:36.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ad21c8cb-80f1-4ba0-9ba5-a52f7db4eced roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45412025-01-16T23:34:36.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ad21c8cb-80f1-4ba0-9ba5-a52f7db4eced resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45422025-01-16T23:34:36.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ad21c8cb-80f1-4ba0-9ba5-a52f7db4eced response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45432025-01-16T23:34:37.001ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
45442025-01-16T23:34:37.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45452025-01-16T23:34:37.001ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
45462025-01-16T23:34:37.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45472025-01-16T23:34:37.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45482025-01-16T23:34:37.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45492025-01-16T23:34:37.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45502025-01-16T23:34:37.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45512025-01-16T23:34:37.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45522025-01-16T23:34:37.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45532025-01-16T23:34:37.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45542025-01-16T23:34:37.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45552025-01-16T23:34:37.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45562025-01-16T23:34:37.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
45572025-01-16T23:34:37.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45582025-01-16T23:34:37.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45592025-01-16T23:34:37.024ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
45602025-01-16T23:34:37.024ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.805938ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
45612025-01-16T23:34:37.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45622025-01-16T23:34:37.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45632025-01-16T23:34:37.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.540621ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45642025-01-16T23:34:37.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1983d3fc-ab82-4937-973f-612847f614b8 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45652025-01-16T23:34:37.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1983d3fc-ab82-4937-973f-612847f614b8 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45662025-01-16T23:34:37.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1983d3fc-ab82-4937-973f-612847f614b8 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45672025-01-16T23:34:38.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d807c86a-99bd-4146-bef7-ef0f1cbd9581 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45682025-01-16T23:34:38.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d807c86a-99bd-4146-bef7-ef0f1cbd9581 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45692025-01-16T23:34:38.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d807c86a-99bd-4146-bef7-ef0f1cbd9581 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45702025-01-16T23:34:39.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9571b3b6-a75c-407b-a4ff-ce99e633da9d roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45712025-01-16T23:34:39.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9571b3b6-a75c-407b-a4ff-ce99e633da9d resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45722025-01-16T23:34:39.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9571b3b6-a75c-407b-a4ff-ce99e633da9d response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45732025-01-16T23:34:40.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2ccbf875-bb47-4b6a-8c6a-73b56182c6b6 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45742025-01-16T23:34:40.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2ccbf875-bb47-4b6a-8c6a-73b56182c6b6 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45752025-01-16T23:34:40.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2ccbf875-bb47-4b6a-8c6a-73b56182c6b6 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45762025-01-16T23:34:41.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 327a4821-137f-48bb-9b76-1295a021be1b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45772025-01-16T23:34:41.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 327a4821-137f-48bb-9b76-1295a021be1b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45782025-01-16T23:34:41.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 327a4821-137f-48bb-9b76-1295a021be1b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45792025-01-16T23:34:42.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8be69ac4-3dd0-4470-9440-61e3a1dd3057 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45802025-01-16T23:34:42.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8be69ac4-3dd0-4470-9440-61e3a1dd3057 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45812025-01-16T23:34:42.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8be69ac4-3dd0-4470-9440-61e3a1dd3057 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45822025-01-16T23:34:43.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a38a67bc-0611-407f-afbf-7a3f196a6ba4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45832025-01-16T23:34:43.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a38a67bc-0611-407f-afbf-7a3f196a6ba4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45842025-01-16T23:34:43.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a38a67bc-0611-407f-afbf-7a3f196a6ba4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45852025-01-16T23:34:44.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 72f7fe81-d017-42b5-9bb7-78d4cdfa9b17 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45862025-01-16T23:34:44.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 72f7fe81-d017-42b5-9bb7-78d4cdfa9b17 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45872025-01-16T23:34:44.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 72f7fe81-d017-42b5-9bb7-78d4cdfa9b17 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45882025-01-16T23:34:45.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d6eb5a42-4fec-497b-9998-1c07c9ea15c9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45892025-01-16T23:34:45.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d6eb5a42-4fec-497b-9998-1c07c9ea15c9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45902025-01-16T23:34:45.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d6eb5a42-4fec-497b-9998-1c07c9ea15c9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45912025-01-16T23:34:45.733ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 559 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = f16683ff-3a5a-45d3-b1ae-57156108e19b response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
45922025-01-16T23:34:46.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6942571c-75bf-4d9c-a993-deda6f9bd5dd roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45932025-01-16T23:34:46.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6942571c-75bf-4d9c-a993-deda6f9bd5dd resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45942025-01-16T23:34:46.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6942571c-75bf-4d9c-a993-deda6f9bd5dd response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
45952025-01-16T23:34:47.001ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
45962025-01-16T23:34:47.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45972025-01-16T23:34:47.001ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
45982025-01-16T23:34:47.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45992025-01-16T23:34:47.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46002025-01-16T23:34:47.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46012025-01-16T23:34:47.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46022025-01-16T23:34:47.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46032025-01-16T23:34:47.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46042025-01-16T23:34:47.005ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.325353ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46052025-01-16T23:34:47.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46062025-01-16T23:34:47.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46072025-01-16T23:34:47.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46082025-01-16T23:34:47.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46092025-01-16T23:34:47.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46102025-01-16T23:34:47.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46112025-01-16T23:34:47.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
46122025-01-16T23:34:47.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46132025-01-16T23:34:47.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46142025-01-16T23:34:47.025ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
46152025-01-16T23:34:47.025ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.44487ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
46162025-01-16T23:34:47.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 73a628ef-d609-49c5-b203-20a7d1739416 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46172025-01-16T23:34:47.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 73a628ef-d609-49c5-b203-20a7d1739416 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46182025-01-16T23:34:47.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 73a628ef-d609-49c5-b203-20a7d1739416 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46192025-01-16T23:34:48.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 56ec3b92-10f4-450a-bc29-7d758d182b0f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46202025-01-16T23:34:48.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 56ec3b92-10f4-450a-bc29-7d758d182b0f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46212025-01-16T23:34:48.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 56ec3b92-10f4-450a-bc29-7d758d182b0f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46222025-01-16T23:34:49.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0eb5138c-a4bd-47de-b5da-bcbc3b18103b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46232025-01-16T23:34:49.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0eb5138c-a4bd-47de-b5da-bcbc3b18103b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46242025-01-16T23:34:49.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0eb5138c-a4bd-47de-b5da-bcbc3b18103b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46252025-01-16T23:34:50.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1ce2fd90-d25e-42f3-afaf-88b8f929b0eb roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46262025-01-16T23:34:50.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1ce2fd90-d25e-42f3-afaf-88b8f929b0eb resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46272025-01-16T23:34:50.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1ce2fd90-d25e-42f3-afaf-88b8f929b0eb response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46282025-01-16T23:34:50.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = ac3bf52c-2dd0-4119-ac63-485f8a45ffc6 roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
46292025-01-16T23:34:50.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = ac3bf52c-2dd0-4119-ac63-485f8a45ffc6 resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
46302025-01-16T23:34:50.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = ac3bf52c-2dd0-4119-ac63-485f8a45ffc6 response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
46312025-01-16T23:34:50.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 2b6059e8-df9d-443c-9e09-6b67e09da275 roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
46322025-01-16T23:34:50.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 2b6059e8-df9d-443c-9e09-6b67e09da275 resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
46332025-01-16T23:34:50.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 2b6059e8-df9d-443c-9e09-6b67e09da275 response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
46342025-01-16T23:34:51.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d8f272ee-a5a2-48e1-b593-d973b82107ae roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46352025-01-16T23:34:51.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d8f272ee-a5a2-48e1-b593-d973b82107ae resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46362025-01-16T23:34:51.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d8f272ee-a5a2-48e1-b593-d973b82107ae response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46372025-01-16T23:34:52.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bcf90f97-0299-478f-bacf-9e1968330ae5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46382025-01-16T23:34:52.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bcf90f97-0299-478f-bacf-9e1968330ae5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46392025-01-16T23:34:52.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bcf90f97-0299-478f-bacf-9e1968330ae5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46402025-01-16T23:34:53.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 44da592d-6b61-4324-8d21-f890580c7071 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46412025-01-16T23:34:53.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 44da592d-6b61-4324-8d21-f890580c7071 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46422025-01-16T23:34:53.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 44da592d-6b61-4324-8d21-f890580c7071 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46432025-01-16T23:34:54.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 59049d1a-fbb9-46ba-b95a-f46cf00445d0 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46442025-01-16T23:34:54.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 59049d1a-fbb9-46ba-b95a-f46cf00445d0 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46452025-01-16T23:34:54.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 59049d1a-fbb9-46ba-b95a-f46cf00445d0 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46462025-01-16T23:34:55.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6fe7fad1-ee3e-4aba-91a1-ca3b9b852354 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46472025-01-16T23:34:55.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6fe7fad1-ee3e-4aba-91a1-ca3b9b852354 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46482025-01-16T23:34:55.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6fe7fad1-ee3e-4aba-91a1-ca3b9b852354 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46492025-01-16T23:34:55.732ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 469 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 5e55111e-2460-473e-951f-f5b7633a4b4d response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
46502025-01-16T23:34:56.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4d91974c-e594-4580-bd1b-3550212d65e4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46512025-01-16T23:34:56.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4d91974c-e594-4580-bd1b-3550212d65e4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46522025-01-16T23:34:56.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4d91974c-e594-4580-bd1b-3550212d65e4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
46532025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
46542025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46552025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
46562025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46572025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
46582025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
46592025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46602025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46612025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
46622025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
46632025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46642025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
46652025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
46662025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46672025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
46682025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46692025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
46702025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46712025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46722025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46732025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
46742025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
46752025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46762025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
46772025-01-16T23:34:57.001ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46782025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46792025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46802025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
46812025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46822025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46832025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46842025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46852025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46862025-01-16T23:34:57.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46872025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46882025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46892025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46902025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46912025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46922025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46932025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46942025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46952025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
46962025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
46972025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46982025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46992025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
47002025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47012025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
47022025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
47032025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47042025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
47052025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47062025-01-16T23:34:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
47072025-01-16T23:34:57.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47082025-01-16T23:34:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47092025-01-16T23:34:57.004ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47102025-01-16T23:34:57.004ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47112025-01-16T23:34:57.005ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.363834ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
47122025-01-16T23:34:57.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47132025-01-16T23:34:57.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47142025-01-16T23:34:57.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47152025-01-16T23:34:57.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
47162025-01-16T23:34:57.007ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47172025-01-16T23:34:57.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47182025-01-16T23:34:57.009ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47192025-01-16T23:34:57.009ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1605, tv_nsec: 324763182 } })
47202025-01-16T23:34:57.009ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47212025-01-16T23:34:57.010ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
47222025-01-16T23:34:57.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47232025-01-16T23:34:57.010ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1605, tv_nsec: 325742280 } })
47242025-01-16T23:34:57.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47252025-01-16T23:34:57.011ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
47262025-01-16T23:34:57.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47272025-01-16T23:34:57.012ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47282025-01-16T23:34:57.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47292025-01-16T23:34:57.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47302025-01-16T23:34:57.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47312025-01-16T23:34:57.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47322025-01-16T23:34:57.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47332025-01-16T23:34:57.014ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47342025-01-16T23:34:57.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47352025-01-16T23:34:57.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47362025-01-16T23:34:57.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47372025-01-16T23:34:57.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47382025-01-16T23:34:57.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47392025-01-16T23:34:57.019ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47402025-01-16T23:34:57.019ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1605, tv_nsec: 334484148 } })
47412025-01-16T23:34:57.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47422025-01-16T23:34:57.019ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
47432025-01-16T23:34:57.020ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47442025-01-16T23:34:57.021ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47452025-01-16T23:34:57.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47462025-01-16T23:34:57.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47472025-01-16T23:34:57.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47482025-01-16T23:34:57.023ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47492025-01-16T23:34:57.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47502025-01-16T23:34:57.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47512025-01-16T23:34:57.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47522025-01-16T23:34:57.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47532025-01-16T23:34:57.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47542025-01-16T23:34:57.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47552025-01-16T23:34:57.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47562025-01-16T23:34:57.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47572025-01-16T23:34:57.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47582025-01-16T23:34:57.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47592025-01-16T23:34:57.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47602025-01-16T23:34:57.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47612025-01-16T23:34:57.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47622025-01-16T23:34:57.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47632025-01-16T23:34:57.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47642025-01-16T23:34:57.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47652025-01-16T23:34:57.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.738165ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47662025-01-16T23:34:57.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.720795ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
47672025-01-16T23:34:57.065ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47682025-01-16T23:34:57.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47692025-01-16T23:34:57.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
47702025-01-16T23:34:57.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47712025-01-16T23:34:57.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47722025-01-16T23:34:57.066ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47732025-01-16T23:34:57.066ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47742025-01-16T23:34:57.066ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47752025-01-16T23:34:57.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47762025-01-16T23:34:57.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47772025-01-16T23:34:57.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47782025-01-16T23:34:57.067ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47792025-01-16T23:34:57.067ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.351255ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
47802025-01-16T23:34:57.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47812025-01-16T23:34:57.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47822025-01-16T23:34:57.068ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47832025-01-16T23:34:57.068ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.210341ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47842025-01-16T23:34:57.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
47852025-01-16T23:34:57.069ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47862025-01-16T23:34:57.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47872025-01-16T23:34:57.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 73.132905ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47882025-01-16T23:34:57.083ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
47892025-01-16T23:34:57.083ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.184089ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
47902025-01-16T23:34:57.097ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 96.540674ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47912025-01-16T23:34:57.099ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47922025-01-16T23:34:57.101ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
47932025-01-16T23:34:57.101ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 100.211265ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
47942025-01-16T23:34:57.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
47952025-01-16T23:34:57.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47962025-01-16T23:34:57.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47972025-01-16T23:34:57.104ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47982025-01-16T23:34:57.104ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 102.747613ms iteration = 22 status = 0
47992025-01-16T23:34:57.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48002025-01-16T23:34:57.108ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48012025-01-16T23:34:57.108ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
48022025-01-16T23:34:57.108ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48032025-01-16T23:34:57.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48042025-01-16T23:34:57.112ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
48052025-01-16T23:34:57.112ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48062025-01-16T23:34:57.112ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "529b1a91-9192-42cd-b64e-bf5d04822bb9", "content-length": "26", "date": "Thu, 16 Jan 2025 23:34:56 GMT"} })
48072025-01-16T23:34:57.112ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48082025-01-16T23:34:57.115ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48092025-01-16T23:34:57.128ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48102025-01-16T23:34:57.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48112025-01-16T23:34:57.132ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 131.325282ms iteration = 25 status = {"physical_disks_added":0}
48122025-01-16T23:34:57.209ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
48132025-01-16T23:34:57.209ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48142025-01-16T23:34:57.210ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1209305-755c-47a1-809e-290aad038377", "content-length": "26", "date": "Thu, 16 Jan 2025 23:34:56 GMT"} })
48152025-01-16T23:34:57.210ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48162025-01-16T23:34:57.211ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
48172025-01-16T23:34:57.223ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
48182025-01-16T23:34:57.223ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48192025-01-16T23:34:57.223ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6487ef57-ead2-4f23-ab16-78be92751e1d", "content-length": "26", "date": "Thu, 16 Jan 2025 23:34:56 GMT"} })
48202025-01-16T23:34:57.223ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48212025-01-16T23:34:57.225ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48222025-01-16T23:34:57.236ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 234.617816ms iteration = 22 status = {}
48232025-01-16T23:34:57.238ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48242025-01-16T23:34:57.238ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48252025-01-16T23:34:57.251ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48262025-01-16T23:34:57.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48272025-01-16T23:34:57.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48282025-01-16T23:34:57.255ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48292025-01-16T23:34:57.255ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48302025-01-16T23:34:57.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48312025-01-16T23:34:57.257ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48322025-01-16T23:34:57.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48332025-01-16T23:34:57.259ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48342025-01-16T23:34:57.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48352025-01-16T23:34:57.264ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3318599c-9138-4881-8c55-d3d41bdbf7ab", "content-length": "372", "date": "Thu, 16 Jan 2025 23:34:57 GMT"} })
48362025-01-16T23:34:57.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48372025-01-16T23:34:57.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48382025-01-16T23:34:57.270ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 267.818534ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
48392025-01-16T23:34:57.275ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48402025-01-16T23:34:57.275ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
48412025-01-16T23:34:57.275ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 273.521803ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
48422025-01-16T23:34:57.304ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
48432025-01-16T23:34:57.304ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
48442025-01-16T23:34:57.305ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ee700092-700d-454e-9045-df47c5299186", "date": "Thu, 16 Jan 2025 23:34:57 GMT"} })
48452025-01-16T23:34:57.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48462025-01-16T23:34:57.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48472025-01-16T23:34:57.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48482025-01-16T23:34:57.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48492025-01-16T23:34:57.308ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48502025-01-16T23:34:57.308ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "db62a722-03e2-4d9f-a16e-40aad3af3b0d", "content-length": "1", "date": "Thu, 16 Jan 2025 23:34:56 GMT"} })
48512025-01-16T23:34:57.309ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48522025-01-16T23:34:57.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48532025-01-16T23:34:57.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48542025-01-16T23:34:57.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48552025-01-16T23:34:57.337ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
48562025-01-16T23:34:57.338ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "55ab49b1-fff3-45fb-b08f-acba911cdee2", "content-length": "691", "date": "Thu, 16 Jan 2025 23:34:57 GMT"} })
48572025-01-16T23:34:57.338ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
48582025-01-16T23:34:57.338ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
48592025-01-16T23:34:57.338ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
48602025-01-16T23:34:57.339ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 338.404919ms iteration = 22 status = {}
48612025-01-16T23:34:57.341ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48622025-01-16T23:34:57.341ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48632025-01-16T23:34:57.341ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "af3dda00-fb5c-4437-8fcf-79a3caf83c17", "date": "Thu, 16 Jan 2025 23:34:57 GMT"} })
48642025-01-16T23:34:57.342ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 340.51593ms iteration = 22 status = null
48652025-01-16T23:34:57.343ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 341.832685ms iteration = 22 status = {}
48662025-01-16T23:34:57.385ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48672025-01-16T23:34:57.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48682025-01-16T23:34:57.388ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
48692025-01-16T23:34:57.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48702025-01-16T23:34:57.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48712025-01-16T23:34:57.396ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48722025-01-16T23:34:57.397ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "eebe7a23-a996-4e04-998a-c1740a4e7b42", "content-length": "134", "date": "Thu, 16 Jan 2025 23:34:56 GMT"} })
48732025-01-16T23:34:57.397ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48742025-01-16T23:34:57.397ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
48752025-01-16T23:34:57.397ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48762025-01-16T23:34:57.397ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48772025-01-16T23:34:57.397ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48782025-01-16T23:34:57.397ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48792025-01-16T23:34:57.397ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48802025-01-16T23:34:57.397ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48812025-01-16T23:34:57.397ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48822025-01-16T23:34:57.397ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48832025-01-16T23:34:57.397ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
48842025-01-16T23:34:57.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48852025-01-16T23:34:57.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48862025-01-16T23:34:57.399ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48872025-01-16T23:34:57.400ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "041cee98-6d0f-4f9f-b52a-3c243a0044e6", "content-length": "2", "date": "Thu, 16 Jan 2025 23:34:56 GMT"} })
48882025-01-16T23:34:57.400ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48892025-01-16T23:34:57.400ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4180342f-d010-49d6-89a9-250c5bae3f71", "content-length": "52", "date": "Thu, 16 Jan 2025 23:34:56 GMT"} })
48902025-01-16T23:34:57.400ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
48912025-01-16T23:34:57.400ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48922025-01-16T23:34:57.494ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8ad7032b-7f44-4612-9a98-04beb2fcf8fd", "date": "Thu, 16 Jan 2025 23:34:57 GMT"} })
48932025-01-16T23:34:57.494ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
48942025-01-16T23:34:57.494ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48952025-01-16T23:34:57.495ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "851d4cc8-9801-49b6-b7b2-be8ff5a64110", "content-length": "682", "date": "Thu, 16 Jan 2025 23:34:57 GMT"} })
48962025-01-16T23:34:57.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48972025-01-16T23:34:57.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48982025-01-16T23:34:57.499ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48992025-01-16T23:34:57.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49002025-01-16T23:34:57.502ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49012025-01-16T23:34:57.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49022025-01-16T23:34:57.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49032025-01-16T23:34:57.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49042025-01-16T23:34:57.511ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 510.330661ms iteration = 22 status = {}
49052025-01-16T23:34:57.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = af365168-d768-4781-8730-df1d3a038581 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49062025-01-16T23:34:57.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = af365168-d768-4781-8730-df1d3a038581 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49072025-01-16T23:34:57.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = af365168-d768-4781-8730-df1d3a038581 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49082025-01-16T23:34:58.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 07332142-af94-4e4c-94a2-00974aef57ab roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49092025-01-16T23:34:58.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 07332142-af94-4e4c-94a2-00974aef57ab resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49102025-01-16T23:34:58.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 07332142-af94-4e4c-94a2-00974aef57ab response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49112025-01-16T23:34:59.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 14034d66-6cc0-408e-8d2e-7848e9c14008 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49122025-01-16T23:34:59.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 14034d66-6cc0-408e-8d2e-7848e9c14008 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49132025-01-16T23:34:59.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 14034d66-6cc0-408e-8d2e-7848e9c14008 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49142025-01-16T23:35:00.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 84ee3c01-d4d3-4e14-97d7-e022c72b58c7 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49152025-01-16T23:35:00.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 84ee3c01-d4d3-4e14-97d7-e022c72b58c7 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49162025-01-16T23:35:00.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 84ee3c01-d4d3-4e14-97d7-e022c72b58c7 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49172025-01-16T23:35:01.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 39102204-0212-4980-99f7-14093073be33 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49182025-01-16T23:35:01.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 39102204-0212-4980-99f7-14093073be33 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49192025-01-16T23:35:01.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 39102204-0212-4980-99f7-14093073be33 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49202025-01-16T23:35:02.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = be66be8f-7c53-49ef-a91c-3b75ab49ad2c roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49212025-01-16T23:35:02.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = be66be8f-7c53-49ef-a91c-3b75ab49ad2c resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49222025-01-16T23:35:02.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = be66be8f-7c53-49ef-a91c-3b75ab49ad2c response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49232025-01-16T23:35:03.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1561aa5c-e4a9-4e5d-9656-275cb101d068 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49242025-01-16T23:35:03.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1561aa5c-e4a9-4e5d-9656-275cb101d068 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49252025-01-16T23:35:03.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1561aa5c-e4a9-4e5d-9656-275cb101d068 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49262025-01-16T23:35:04.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f1a1dfc5-1f11-42b1-9830-5120d6726bb2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49272025-01-16T23:35:04.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f1a1dfc5-1f11-42b1-9830-5120d6726bb2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49282025-01-16T23:35:04.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f1a1dfc5-1f11-42b1-9830-5120d6726bb2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49292025-01-16T23:35:05.733ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 535 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 8d6093f6-3770-403e-996a-6a9ea8b9f25c response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
49302025-01-16T23:35:05.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 66981484-191c-4982-be70-47344b67b32e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49312025-01-16T23:35:05.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 66981484-191c-4982-be70-47344b67b32e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49322025-01-16T23:35:05.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 66981484-191c-4982-be70-47344b67b32e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49332025-01-16T23:35:06.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 63f52691-b9d3-4221-a44f-b201c7188683 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49342025-01-16T23:35:06.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 63f52691-b9d3-4221-a44f-b201c7188683 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49352025-01-16T23:35:06.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 63f52691-b9d3-4221-a44f-b201c7188683 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49362025-01-16T23:35:07.001ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
49372025-01-16T23:35:07.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49382025-01-16T23:35:07.001ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
49392025-01-16T23:35:07.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49402025-01-16T23:35:07.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49412025-01-16T23:35:07.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49422025-01-16T23:35:07.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49432025-01-16T23:35:07.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49442025-01-16T23:35:07.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49452025-01-16T23:35:07.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49462025-01-16T23:35:07.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49472025-01-16T23:35:07.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49482025-01-16T23:35:07.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49492025-01-16T23:35:07.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
49502025-01-16T23:35:07.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49512025-01-16T23:35:07.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49522025-01-16T23:35:07.024ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
49532025-01-16T23:35:07.024ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.135285ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
49542025-01-16T23:35:07.026ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49552025-01-16T23:35:07.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49562025-01-16T23:35:07.027ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 26.393767ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49572025-01-16T23:35:07.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 46ee96b0-32ab-4618-9b35-e360ba590e51 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49582025-01-16T23:35:07.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 46ee96b0-32ab-4618-9b35-e360ba590e51 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49592025-01-16T23:35:07.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 46ee96b0-32ab-4618-9b35-e360ba590e51 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49602025-01-16T23:35:08.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 34bb4698-a101-4761-b0fc-2ed4a8b87b29 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49612025-01-16T23:35:08.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 34bb4698-a101-4761-b0fc-2ed4a8b87b29 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49622025-01-16T23:35:08.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 34bb4698-a101-4761-b0fc-2ed4a8b87b29 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49632025-01-16T23:35:09.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5397ab9f-a8b9-454c-9433-47a5614e426f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49642025-01-16T23:35:09.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5397ab9f-a8b9-454c-9433-47a5614e426f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49652025-01-16T23:35:09.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5397ab9f-a8b9-454c-9433-47a5614e426f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49662025-01-16T23:35:10.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fda4c54c-0d81-4ec6-9476-8e59be1c1933 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49672025-01-16T23:35:10.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fda4c54c-0d81-4ec6-9476-8e59be1c1933 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49682025-01-16T23:35:10.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fda4c54c-0d81-4ec6-9476-8e59be1c1933 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49692025-01-16T23:35:11.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 511b54f0-6491-4f1f-baf6-d16b2de33789 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49702025-01-16T23:35:11.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 511b54f0-6491-4f1f-baf6-d16b2de33789 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49712025-01-16T23:35:11.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 511b54f0-6491-4f1f-baf6-d16b2de33789 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49722025-01-16T23:35:12.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cb523660-29b2-4b93-9520-c8e6d9a48a3b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49732025-01-16T23:35:12.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cb523660-29b2-4b93-9520-c8e6d9a48a3b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49742025-01-16T23:35:12.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cb523660-29b2-4b93-9520-c8e6d9a48a3b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49752025-01-16T23:35:13.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f5dbe391-3bd8-4f15-a7c5-0ad3a338c1c1 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49762025-01-16T23:35:13.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f5dbe391-3bd8-4f15-a7c5-0ad3a338c1c1 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49772025-01-16T23:35:13.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f5dbe391-3bd8-4f15-a7c5-0ad3a338c1c1 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49782025-01-16T23:35:14.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b3965a51-3da9-4ac3-9e33-1f2fe028f35e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49792025-01-16T23:35:14.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b3965a51-3da9-4ac3-9e33-1f2fe028f35e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49802025-01-16T23:35:14.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b3965a51-3da9-4ac3-9e33-1f2fe028f35e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49812025-01-16T23:35:15.733ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 563 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 40e5201a-931f-406d-8e05-25af07a67604 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
49822025-01-16T23:35:15.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aaec13da-6b5c-4f28-a121-a520e02038f3 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49832025-01-16T23:35:15.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aaec13da-6b5c-4f28-a121-a520e02038f3 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49842025-01-16T23:35:15.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aaec13da-6b5c-4f28-a121-a520e02038f3 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
49852025-01-16T23:35:17.001ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
49862025-01-16T23:35:17.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49872025-01-16T23:35:17.001ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
49882025-01-16T23:35:17.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49892025-01-16T23:35:17.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49902025-01-16T23:35:17.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49912025-01-16T23:35:17.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49922025-01-16T23:35:17.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49932025-01-16T23:35:17.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49942025-01-16T23:35:17.005ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.878265ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49952025-01-16T23:35:17.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49962025-01-16T23:35:17.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49972025-01-16T23:35:17.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49982025-01-16T23:35:17.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49992025-01-16T23:35:17.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50002025-01-16T23:35:17.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50012025-01-16T23:35:17.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
50022025-01-16T23:35:17.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50032025-01-16T23:35:17.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50042025-01-16T23:35:17.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 23a5fbd8-1b1a-4356-a53b-7bce9e33f32d roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50052025-01-16T23:35:17.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 23a5fbd8-1b1a-4356-a53b-7bce9e33f32d resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50062025-01-16T23:35:17.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 23a5fbd8-1b1a-4356-a53b-7bce9e33f32d response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50072025-01-16T23:35:17.023ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
50082025-01-16T23:35:17.023ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.907131ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
50092025-01-16T23:35:18.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 355be4ba-7803-4e59-a1ae-4aba263502ef roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50102025-01-16T23:35:18.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 355be4ba-7803-4e59-a1ae-4aba263502ef resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50112025-01-16T23:35:18.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 355be4ba-7803-4e59-a1ae-4aba263502ef response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50122025-01-16T23:35:19.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 520db702-feed-4af8-9f09-603aa82a9742 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50132025-01-16T23:35:19.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 520db702-feed-4af8-9f09-603aa82a9742 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50142025-01-16T23:35:19.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 520db702-feed-4af8-9f09-603aa82a9742 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50152025-01-16T23:35:20.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c2ff3b31-0407-401b-93cc-2127ce63116b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50162025-01-16T23:35:20.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c2ff3b31-0407-401b-93cc-2127ce63116b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50172025-01-16T23:35:20.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c2ff3b31-0407-401b-93cc-2127ce63116b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50182025-01-16T23:35:20.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 1461b3fc-e064-42b4-9eac-862dd0515be1 roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
50192025-01-16T23:35:20.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 1461b3fc-e064-42b4-9eac-862dd0515be1 resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
50202025-01-16T23:35:20.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = 1461b3fc-e064-42b4-9eac-862dd0515be1 response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
50212025-01-16T23:35:20.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = e1d321d4-bf92-4957-afc3-e547d0949393 roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
50222025-01-16T23:35:20.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = e1d321d4-bf92-4957-afc3-e547d0949393 resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
50232025-01-16T23:35:20.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49710 req_id = e1d321d4-bf92-4957-afc3-e547d0949393 response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
50242025-01-16T23:35:21.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a83097c0-6852-4207-bdaf-1d942a9889b2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50252025-01-16T23:35:21.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a83097c0-6852-4207-bdaf-1d942a9889b2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50262025-01-16T23:35:21.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a83097c0-6852-4207-bdaf-1d942a9889b2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50272025-01-16T23:35:22.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fe07cd40-be85-4b2f-83a9-4cf0e42099cb roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50282025-01-16T23:35:22.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fe07cd40-be85-4b2f-83a9-4cf0e42099cb resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50292025-01-16T23:35:22.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fe07cd40-be85-4b2f-83a9-4cf0e42099cb response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50302025-01-16T23:35:23.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 949020f3-a7d8-4d81-9b27-e156a33fb5f5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50312025-01-16T23:35:23.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 949020f3-a7d8-4d81-9b27-e156a33fb5f5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50322025-01-16T23:35:23.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 949020f3-a7d8-4d81-9b27-e156a33fb5f5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50332025-01-16T23:35:24.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8f65d07b-de7f-4519-9c2c-d4b2af238445 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50342025-01-16T23:35:24.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8f65d07b-de7f-4519-9c2c-d4b2af238445 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50352025-01-16T23:35:24.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8f65d07b-de7f-4519-9c2c-d4b2af238445 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50362025-01-16T23:35:25.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 56569332-a3e2-45bf-985c-72a1d55afbb4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50372025-01-16T23:35:25.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 56569332-a3e2-45bf-985c-72a1d55afbb4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50382025-01-16T23:35:25.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 56569332-a3e2-45bf-985c-72a1d55afbb4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50392025-01-16T23:35:25.732ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 558 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = af5ca1f9-2747-4582-96da-fe5e6c093d7d response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
50402025-01-16T23:35:26.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 75fcf3a5-e490-4188-b5e2-c488faca7c27 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50412025-01-16T23:35:26.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 75fcf3a5-e490-4188-b5e2-c488faca7c27 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50422025-01-16T23:35:26.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1733 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 75fcf3a5-e490-4188-b5e2-c488faca7c27 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
50432025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
50442025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50452025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
50462025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50472025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
50482025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
50492025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
50502025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50512025-01-16T23:35:27.002ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-16 23:25:27.002355432 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
50522025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
50532025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
50542025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
50552025-01-16T23:35:27.002ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
50562025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
50572025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50582025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50592025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
50602025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50612025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
50622025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
50632025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50642025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
50652025-01-16T23:35:27.002ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca
50662025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
50672025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.6\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca"}
50682025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
50692025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50702025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50712025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50722025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
50732025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
50742025-01-16T23:35:27.002ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50752025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50762025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
50772025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50782025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
50792025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50802025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
50812025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
50822025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
50832025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50842025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
50852025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
50862025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50872025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
50882025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
50892025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50902025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50912025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
50922025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
50932025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50942025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50952025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
50962025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50972025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50982025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
50992025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51002025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
51012025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51022025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
51032025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
51042025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
51052025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
51062025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
51072025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
51082025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51092025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51102025-01-16T23:35:27.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51112025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
51122025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
51132025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
51142025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51152025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51162025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51172025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51182025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51192025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51202025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51212025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51222025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51232025-01-16T23:35:27.003ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dc5f3810-93b6-44f1-815c-44411abf99ad.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1635, tv_nsec: 317930570 } })
51242025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51252025-01-16T23:35:27.003ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5c1ab32c-50b8-4564-bf29-e388b915cbdb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd10c057-8c9f-4db2-98b5-bcf5e0d536ba.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1635, tv_nsec: 317948951 } })
51262025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51272025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51282025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51292025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
51302025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51312025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
51322025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
51332025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
51342025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
51352025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.175603ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
51362025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
51372025-01-16T23:35:27.003ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.454097ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
51382025-01-16T23:35:27.005ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51392025-01-16T23:35:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51402025-01-16T23:35:27.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51412025-01-16T23:35:27.007ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.573528ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
51422025-01-16T23:35:27.008ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-16 23:25:27.002355432 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
51432025-01-16T23:35:27.008ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.869683ms iteration = 12 status = {"expiration":"2025-01-16T23:25:27.002355432Z","pruned":[]}
51442025-01-16T23:35:27.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51452025-01-16T23:35:27.008ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1635, tv_nsec: 323185291 } })
51462025-01-16T23:35:27.008ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
51472025-01-16T23:35:27.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51482025-01-16T23:35:27.009ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51492025-01-16T23:35:27.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51502025-01-16T23:35:27.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51512025-01-16T23:35:27.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51522025-01-16T23:35:27.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51532025-01-16T23:35:27.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51542025-01-16T23:35:27.010ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51552025-01-16T23:35:27.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51562025-01-16T23:35:27.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51572025-01-16T23:35:27.011ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51582025-01-16T23:35:27.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51592025-01-16T23:35:27.013ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51602025-01-16T23:35:27.013ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51612025-01-16T23:35:27.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51622025-01-16T23:35:27.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51632025-01-16T23:35:27.013ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51642025-01-16T23:35:27.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
51652025-01-16T23:35:27.014ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51662025-01-16T23:35:27.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51672025-01-16T23:35:27.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51682025-01-16T23:35:27.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51692025-01-16T23:35:27.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51702025-01-16T23:35:27.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51712025-01-16T23:35:27.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51722025-01-16T23:35:27.015ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51732025-01-16T23:35:27.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51742025-01-16T23:35:27.016ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51752025-01-16T23:35:27.016ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51762025-01-16T23:35:27.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51772025-01-16T23:35:27.016ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1635, tv_nsec: 331516871 } })
51782025-01-16T23:35:27.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51792025-01-16T23:35:27.017ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
51802025-01-16T23:35:27.017ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51812025-01-16T23:35:27.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
51822025-01-16T23:35:27.020ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51832025-01-16T23:35:27.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
51842025-01-16T23:35:27.021ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51852025-01-16T23:35:27.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51862025-01-16T23:35:27.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51872025-01-16T23:35:27.025ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.010852ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
51882025-01-16T23:35:27.026ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51892025-01-16T23:35:27.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51902025-01-16T23:35:27.027ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
51912025-01-16T23:35:27.027ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
51922025-01-16T23:35:27.027ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 24.900968ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
51932025-01-16T23:35:27.031ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51942025-01-16T23:35:27.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51952025-01-16T23:35:27.034ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1635, tv_nsec: 349157870 } })
51962025-01-16T23:35:27.034ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
51972025-01-16T23:35:27.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51982025-01-16T23:35:27.061ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.391761ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
51992025-01-16T23:35:27.061ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.283999ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52002025-01-16T23:35:27.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52012025-01-16T23:35:27.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52022025-01-16T23:35:27.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.330046ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52032025-01-16T23:35:27.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52042025-01-16T23:35:27.066ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52052025-01-16T23:35:27.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.217653ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
52062025-01-16T23:35:27.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52072025-01-16T23:35:27.067ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
52082025-01-16T23:35:27.067ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
52092025-01-16T23:35:27.067ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 64.829265ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
52102025-01-16T23:35:27.068ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52112025-01-16T23:35:27.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52122025-01-16T23:35:27.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52132025-01-16T23:35:27.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
52142025-01-16T23:35:27.071ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52152025-01-16T23:35:27.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52162025-01-16T23:35:27.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52172025-01-16T23:35:27.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52182025-01-16T23:35:27.073ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52192025-01-16T23:35:27.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52202025-01-16T23:35:27.073ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
52212025-01-16T23:35:27.073ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 71.228028ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
52222025-01-16T23:35:27.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52232025-01-16T23:35:27.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52242025-01-16T23:35:27.075ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52252025-01-16T23:35:27.076ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52262025-01-16T23:35:27.076ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52272025-01-16T23:35:27.076ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52282025-01-16T23:35:27.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52292025-01-16T23:35:27.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52302025-01-16T23:35:27.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52312025-01-16T23:35:27.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52322025-01-16T23:35:27.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52332025-01-16T23:35:27.077ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52342025-01-16T23:35:27.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52352025-01-16T23:35:27.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52362025-01-16T23:35:27.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52372025-01-16T23:35:27.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52382025-01-16T23:35:27.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52392025-01-16T23:35:27.079ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52402025-01-16T23:35:27.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52412025-01-16T23:35:27.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52422025-01-16T23:35:27.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52432025-01-16T23:35:27.081ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
52442025-01-16T23:35:27.081ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 78.60972ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
52452025-01-16T23:35:27.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
52462025-01-16T23:35:27.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52472025-01-16T23:35:27.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52482025-01-16T23:35:27.088ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52492025-01-16T23:35:27.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52502025-01-16T23:35:27.092ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52512025-01-16T23:35:27.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52522025-01-16T23:35:27.110ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
52532025-01-16T23:35:27.110ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 108.003034ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
52542025-01-16T23:35:27.112ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52552025-01-16T23:35:27.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52562025-01-16T23:35:27.115ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52572025-01-16T23:35:27.115ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52582025-01-16T23:35:27.115ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52592025-01-16T23:35:27.115ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.258346ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52602025-01-16T23:35:27.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52612025-01-16T23:35:27.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 114.273205ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52622025-01-16T23:35:27.119ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
52632025-01-16T23:35:27.124ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52642025-01-16T23:35:27.127ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
52652025-01-16T23:35:27.127ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
52662025-01-16T23:35:27.127ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
52672025-01-16T23:35:27.127ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52682025-01-16T23:35:27.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52692025-01-16T23:35:27.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
52702025-01-16T23:35:27.128ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52712025-01-16T23:35:27.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52722025-01-16T23:35:27.128ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
52732025-01-16T23:35:27.128ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
52742025-01-16T23:35:27.128ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
52752025-01-16T23:35:27.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52762025-01-16T23:35:27.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52772025-01-16T23:35:27.130ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52782025-01-16T23:35:27.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52792025-01-16T23:35:27.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52802025-01-16T23:35:27.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52812025-01-16T23:35:27.136ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52822025-01-16T23:35:27.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52832025-01-16T23:35:27.141ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
52842025-01-16T23:35:27.150ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
52852025-01-16T23:35:27.150ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52862025-01-16T23:35:27.150ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fe8f9bb-1957-41f2-a504-84f6d1425851", "content-length": "26", "date": "Thu, 16 Jan 2025 23:35:26 GMT"} })
52872025-01-16T23:35:27.150ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52882025-01-16T23:35:27.153ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52892025-01-16T23:35:27.155ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52902025-01-16T23:35:27.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
52912025-01-16T23:35:27.158ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52922025-01-16T23:35:27.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52932025-01-16T23:35:27.158ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52942025-01-16T23:35:27.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52952025-01-16T23:35:27.161ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 158.896862ms iteration = 23 status = 0
52962025-01-16T23:35:27.164ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52972025-01-16T23:35:27.165ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 162.885328ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
52982025-01-16T23:35:27.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52992025-01-16T23:35:27.167ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53002025-01-16T23:35:27.167ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53012025-01-16T23:35:27.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53022025-01-16T23:35:27.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53032025-01-16T23:35:27.169ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53042025-01-16T23:35:27.171ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53052025-01-16T23:35:27.171ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53062025-01-16T23:35:27.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53072025-01-16T23:35:27.174ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
53082025-01-16T23:35:27.174ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
53092025-01-16T23:35:27.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53102025-01-16T23:35:27.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53112025-01-16T23:35:27.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53122025-01-16T23:35:27.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53132025-01-16T23:35:27.179ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53142025-01-16T23:35:27.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53152025-01-16T23:35:27.179ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
53162025-01-16T23:35:27.179ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53172025-01-16T23:35:27.179ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "610dd92d-9283-47cb-97c3-1907e41e53b4", "content-length": "26", "date": "Thu, 16 Jan 2025 23:35:26 GMT"} })
53182025-01-16T23:35:27.179ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53192025-01-16T23:35:27.187ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
53202025-01-16T23:35:27.187ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53212025-01-16T23:35:27.187ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
53222025-01-16T23:35:27.187ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8237d437-6e74-4794-aafe-35b3d2f4d36b", "content-length": "26", "date": "Thu, 16 Jan 2025 23:35:26 GMT"} })
53232025-01-16T23:35:27.187ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53242025-01-16T23:35:27.189ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53252025-01-16T23:35:27.194ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53262025-01-16T23:35:27.196ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53272025-01-16T23:35:27.196ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53282025-01-16T23:35:27.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53292025-01-16T23:35:27.204ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 201.598421ms iteration = 26 status = {"physical_disks_added":0}
53302025-01-16T23:35:27.204ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
53312025-01-16T23:35:27.204ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 0 version = 2
53322025-01-16T23:35:27.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53332025-01-16T23:35:27.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53342025-01-16T23:35:27.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53352025-01-16T23:35:27.209ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
53362025-01-16T23:35:27.209ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 206.827912ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
53372025-01-16T23:35:27.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53382025-01-16T23:35:27.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53392025-01-16T23:35:27.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53402025-01-16T23:35:27.212ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 1 version = 2
53412025-01-16T23:35:27.212ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
53422025-01-16T23:35:27.212ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-16 23:25:21.695734 UTC dns_group = external generation = 2
53432025-01-16T23:35:27.212ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 209.87122ms iteration = 12 status = {"generation":2}
53442025-01-16T23:35:27.218ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-16T23:24:20.471931Z, time_modified: 2025-01-16T23:24:20.471931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }) }
53452025-01-16T23:35:27.219ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 216.394476ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]}},"default_endpoint":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
53462025-01-16T23:35:27.226ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53472025-01-16T23:35:27.228ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53482025-01-16T23:35:27.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53492025-01-16T23:35:27.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53502025-01-16T23:35:27.235ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
53512025-01-16T23:35:27.235ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
53522025-01-16T23:35:27.235ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-16 23:25:20.756297 UTC dns_group = internal generation = 1
53532025-01-16T23:35:27.235ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 233.064496ms iteration = 12 status = {"generation":1}
53542025-01-16T23:35:27.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 23cdbe71-2fe5-400b-807d-c7726f161c90 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
53552025-01-16T23:35:27.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 23cdbe71-2fe5-400b-807d-c7726f161c90 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
53562025-01-16T23:35:27.272ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
53572025-01-16T23:35:27.374ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53582025-01-16T23:35:27.374ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53592025-01-16T23:35:27.374ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d75c2465-4887-420d-b5ec-7bb2c3b131f5", "content-length": "372", "date": "Thu, 16 Jan 2025 23:35:27 GMT"} })
53602025-01-16T23:35:27.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53612025-01-16T23:35:27.374ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53622025-01-16T23:35:27.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53632025-01-16T23:35:27.375ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "059e5c28-e3bb-48e1-9512-bcae5ea539b2", "content-length": "1", "date": "Thu, 16 Jan 2025 23:35:26 GMT"} })
53642025-01-16T23:35:27.377ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53652025-01-16T23:35:27.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53662025-01-16T23:35:27.415ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53672025-01-16T23:35:27.415ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "497c78d1-2225-4573-bed5-0c4d70fdfcce", "content-length": "691", "date": "Thu, 16 Jan 2025 23:35:27 GMT"} })
53682025-01-16T23:35:27.415ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
53692025-01-16T23:35:27.415ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
53702025-01-16T23:35:27.415ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
53712025-01-16T23:35:27.416ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 414.679194ms iteration = 23 status = {}
53722025-01-16T23:35:27.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 23cdbe71-2fe5-400b-807d-c7726f161c90 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
53732025-01-16T23:35:27.418ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 415.45305ms iteration = 23 status = null
53742025-01-16T23:35:27.431ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
53752025-01-16T23:35:27.431ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "794d7ea8-f642-46d5-809d-1ca6f8ff5eea", "date": "Thu, 16 Jan 2025 23:35:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53762025-01-16T23:35:27.431ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53772025-01-16T23:35:27.432ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "da5e087e-695e-4678-b5b8-2f1376ac02fa", "date": "Thu, 16 Jan 2025 23:35:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53782025-01-16T23:35:27.432ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53792025-01-16T23:35:27.434ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "be323b11-e37a-4a56-94af-442737e3436a", "date": "Thu, 16 Jan 2025 23:35:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53802025-01-16T23:35:27.434ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53812025-01-16T23:35:27.435ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53822025-01-16T23:35:27.435ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 433.574277ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
53832025-01-16T23:35:27.460ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
53842025-01-16T23:35:27.460ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
53852025-01-16T23:35:27.462ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e95b57e7-0b62-4ea2-9be0-8a53b7d05de1", "date": "Thu, 16 Jan 2025 23:35:27 GMT"} })
53862025-01-16T23:35:27.462ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53872025-01-16T23:35:27.462ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
53882025-01-16T23:35:27.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53892025-01-16T23:35:27.462ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9c272ea0-6b78-446b-9c9c-b08192c9d5fd", "date": "Thu, 16 Jan 2025 23:35:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53902025-01-16T23:35:27.462ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53912025-01-16T23:35:27.463ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3a8e1c01-5771-4645-bc8c-a2f5ce23833a", "date": "Thu, 16 Jan 2025 23:35:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53922025-01-16T23:35:27.463ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53932025-01-16T23:35:27.464ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53942025-01-16T23:35:27.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53952025-01-16T23:35:27.465ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 463.188386ms iteration = 23 status = {}
53962025-01-16T23:35:27.465ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53972025-01-16T23:35:27.465ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 463.258487ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
53982025-01-16T23:35:27.468ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53992025-01-16T23:35:27.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54002025-01-16T23:35:27.471ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
54012025-01-16T23:35:27.471ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54022025-01-16T23:35:27.472ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "baf59d88-eafa-47f0-b1a5-b751a1b64963", "date": "Thu, 16 Jan 2025 23:35:27 GMT"} })
54032025-01-16T23:35:27.473ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 470.918914ms iteration = 23 status = {}
54042025-01-16T23:35:27.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54052025-01-16T23:35:27.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54062025-01-16T23:35:27.507ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
54072025-01-16T23:35:27.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54082025-01-16T23:35:27.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54092025-01-16T23:35:27.517ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
54102025-01-16T23:35:27.517ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7923c07b-2084-49fd-b4c2-79b8dd8a0f10", "content-length": "134", "date": "Thu, 16 Jan 2025 23:35:26 GMT"} })
54112025-01-16T23:35:27.517ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
54122025-01-16T23:35:27.517ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
54132025-01-16T23:35:27.517ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
54142025-01-16T23:35:27.517ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54152025-01-16T23:35:27.517ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54162025-01-16T23:35:27.517ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54172025-01-16T23:35:27.517ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54182025-01-16T23:35:27.517ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54192025-01-16T23:35:27.517ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54202025-01-16T23:35:27.517ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54212025-01-16T23:35:27.518ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
54222025-01-16T23:35:27.518ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54232025-01-16T23:35:27.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54242025-01-16T23:35:27.519ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
54252025-01-16T23:35:27.519ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4142e29b-6f93-418e-b886-ff18ab808c07", "content-length": "2", "date": "Thu, 16 Jan 2025 23:35:26 GMT"} })
54262025-01-16T23:35:27.519ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
54272025-01-16T23:35:27.519ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb4cb36e-b4d4-4b80-b2e5-63d4054149a3", "content-length": "52", "date": "Thu, 16 Jan 2025 23:35:26 GMT"} })
54282025-01-16T23:35:27.519ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
54292025-01-16T23:35:27.519ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
54302025-01-16T23:35:27.608ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cbe8fd8d-0453-4d7d-86ec-0341b2304001", "date": "Thu, 16 Jan 2025 23:35:27 GMT"} })
54312025-01-16T23:35:27.608ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
54322025-01-16T23:35:27.608ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54332025-01-16T23:35:27.608ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "70b7f3c2-e948-4bff-b6d8-014d1fa75491", "content-length": "682", "date": "Thu, 16 Jan 2025 23:35:27 GMT"} })
54342025-01-16T23:35:27.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54352025-01-16T23:35:27.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54362025-01-16T23:35:27.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54372025-01-16T23:35:27.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54382025-01-16T23:35:27.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54392025-01-16T23:35:27.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54402025-01-16T23:35:27.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54412025-01-16T23:35:27.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54422025-01-16T23:35:27.625ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 622.950804ms iteration = 23 status = {}
54432025-01-16T23:35:28.078ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
54442025-01-16T23:35:28.078ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
54452025-01-16T23:35:28.109ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
54462025-01-16T23:35:28.109ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:52707
54472025-01-16T23:35:28.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52707 req_id = 323132eb-d9ba-46fa-894e-76ca48fae247 roles = RoleSet { roles: {} } uri = /metrics/producers
54482025-01-16T23:35:28.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52707 req_id = 323132eb-d9ba-46fa-894e-76ca48fae247 resource = Database result = Ok(()) uri = /metrics/producers
54492025-01-16T23:35:28.164ZINFOnexus: assigned collector to new producer collector_id = 0a365f9e-6c70-4a27-ba2b-6123ad53013e file = nexus/src/app/oximeter.rs:76 producer_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
54502025-01-16T23:35:28.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55522 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52707 req_id = 323132eb-d9ba-46fa-894e-76ca48fae247 response_code = 201 uri = /metrics/producers
54512025-01-16T23:35:28.164ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "323132eb-d9ba-46fa-894e-76ca48fae247", "content-length": "41", "date": "Thu, 16 Jan 2025 23:35:27 GMT"} })
54522025-01-16T23:35:28.167ZDEBGnexus (producer-registration-task): registered with nexus successfully
54532025-01-16T23:35:28.167ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
54542025-01-16T23:35:28.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b7c1b7b0-40dd-4803-ae6e-a0fc972959c3 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54552025-01-16T23:35:28.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b7c1b7b0-40dd-4803-ae6e-a0fc972959c3 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54562025-01-16T23:35:28.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b7c1b7b0-40dd-4803-ae6e-a0fc972959c3 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54572025-01-16T23:35:29.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3c9c5695-1ed6-43af-b2ee-90bf3decab9d roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54582025-01-16T23:35:29.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3c9c5695-1ed6-43af-b2ee-90bf3decab9d resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54592025-01-16T23:35:29.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3c9c5695-1ed6-43af-b2ee-90bf3decab9d response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54602025-01-16T23:35:30.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f398600d-561e-480d-87d7-1311e8e1b486 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54612025-01-16T23:35:30.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f398600d-561e-480d-87d7-1311e8e1b486 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54622025-01-16T23:35:30.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f398600d-561e-480d-87d7-1311e8e1b486 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54632025-01-16T23:35:31.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dae14de6-7b88-4229-9df9-53815ebbfe78 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54642025-01-16T23:35:31.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dae14de6-7b88-4229-9df9-53815ebbfe78 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54652025-01-16T23:35:31.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = dae14de6-7b88-4229-9df9-53815ebbfe78 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54662025-01-16T23:35:32.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 15e530bd-a426-46fe-8d2f-1805de531686 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54672025-01-16T23:35:32.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 15e530bd-a426-46fe-8d2f-1805de531686 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54682025-01-16T23:35:32.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 15e530bd-a426-46fe-8d2f-1805de531686 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54692025-01-16T23:35:33.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c881d358-4906-4e2c-bc77-4e73171d3061 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54702025-01-16T23:35:33.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c881d358-4906-4e2c-bc77-4e73171d3061 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54712025-01-16T23:35:33.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c881d358-4906-4e2c-bc77-4e73171d3061 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54722025-01-16T23:35:34.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 22a7d80a-0a2b-467f-82a8-708302fd8e91 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54732025-01-16T23:35:34.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 22a7d80a-0a2b-467f-82a8-708302fd8e91 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54742025-01-16T23:35:34.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 22a7d80a-0a2b-467f-82a8-708302fd8e91 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54752025-01-16T23:35:35.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 25377c45-5c6a-4236-a23d-d151afc5953f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54762025-01-16T23:35:35.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 25377c45-5c6a-4236-a23d-d151afc5953f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54772025-01-16T23:35:35.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 25377c45-5c6a-4236-a23d-d151afc5953f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54782025-01-16T23:35:35.733ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 547 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = af49ac44-1c1f-4258-b16f-701491174f53 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
54792025-01-16T23:35:36.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2ecab026-6091-4f02-8c66-f335a8c23631 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54802025-01-16T23:35:36.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2ecab026-6091-4f02-8c66-f335a8c23631 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54812025-01-16T23:35:36.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2ecab026-6091-4f02-8c66-f335a8c23631 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
54822025-01-16T23:35:37.001ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
54832025-01-16T23:35:37.001ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
54842025-01-16T23:35:37.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54852025-01-16T23:35:37.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54862025-01-16T23:35:37.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54872025-01-16T23:35:37.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54882025-01-16T23:35:37.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54892025-01-16T23:35:37.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54902025-01-16T23:35:37.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54912025-01-16T23:35:37.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54922025-01-16T23:35:37.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54932025-01-16T23:35:37.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54942025-01-16T23:35:37.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.790059ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54952025-01-16T23:35:37.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54962025-01-16T23:35:37.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54972025-01-16T23:35:37.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54982025-01-16T23:35:37.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
54992025-01-16T23:35:37.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55002025-01-16T23:35:37.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55012025-01-16T23:35:37.052ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
55022025-01-16T23:35:37.052ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.939189ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
55032025-01-16T23:35:37.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f516023b-db46-4a5e-a29a-b4d5d36b9863 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55042025-01-16T23:35:37.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f516023b-db46-4a5e-a29a-b4d5d36b9863 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55052025-01-16T23:35:37.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f516023b-db46-4a5e-a29a-b4d5d36b9863 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55062025-01-16T23:35:38.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4847ba49-f2f5-4ad9-bdad-b4d2ba1ee1c3 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55072025-01-16T23:35:38.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4847ba49-f2f5-4ad9-bdad-b4d2ba1ee1c3 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55082025-01-16T23:35:38.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4847ba49-f2f5-4ad9-bdad-b4d2ba1ee1c3 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55092025-01-16T23:35:39.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f691d9f6-b07c-4647-8d04-d0de6e627fa5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55102025-01-16T23:35:39.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f691d9f6-b07c-4647-8d04-d0de6e627fa5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55112025-01-16T23:35:39.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f691d9f6-b07c-4647-8d04-d0de6e627fa5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55122025-01-16T23:35:40.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3d6d1ef4-ebc8-4831-9ca8-2da6bf7e4dc5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55132025-01-16T23:35:40.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3d6d1ef4-ebc8-4831-9ca8-2da6bf7e4dc5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55142025-01-16T23:35:40.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3d6d1ef4-ebc8-4831-9ca8-2da6bf7e4dc5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55152025-01-16T23:35:41.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7d492a2b-4841-4509-ac47-89a4c3ffaa8a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55162025-01-16T23:35:41.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7d492a2b-4841-4509-ac47-89a4c3ffaa8a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55172025-01-16T23:35:41.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1698 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7d492a2b-4841-4509-ac47-89a4c3ffaa8a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55182025-01-16T23:35:42.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ecc1d03d-817a-45af-9fc0-4c8caa00f6aa roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55192025-01-16T23:35:42.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ecc1d03d-817a-45af-9fc0-4c8caa00f6aa resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55202025-01-16T23:35:42.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ecc1d03d-817a-45af-9fc0-4c8caa00f6aa response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55212025-01-16T23:35:43.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 894cda58-66b8-4a26-aae7-31d683254f73 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55222025-01-16T23:35:43.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 894cda58-66b8-4a26-aae7-31d683254f73 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55232025-01-16T23:35:43.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 894cda58-66b8-4a26-aae7-31d683254f73 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55242025-01-16T23:35:44.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a5f5b139-fa7f-443a-912e-160a79b7f811 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55252025-01-16T23:35:44.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a5f5b139-fa7f-443a-912e-160a79b7f811 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55262025-01-16T23:35:44.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a5f5b139-fa7f-443a-912e-160a79b7f811 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55272025-01-16T23:35:45.732ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 510 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 83629e5d-40a8-421d-b4fc-b7c772b2522c response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
55282025-01-16T23:35:45.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1ec6f0ba-7d63-4df1-a711-67a892e834d9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55292025-01-16T23:35:45.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1ec6f0ba-7d63-4df1-a711-67a892e834d9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55302025-01-16T23:35:45.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1ec6f0ba-7d63-4df1-a711-67a892e834d9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55312025-01-16T23:35:46.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e2a27f71-56bf-4530-bbbf-7b74da9a720f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55322025-01-16T23:35:46.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e2a27f71-56bf-4530-bbbf-7b74da9a720f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55332025-01-16T23:35:46.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e2a27f71-56bf-4530-bbbf-7b74da9a720f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55342025-01-16T23:35:47.002ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
55352025-01-16T23:35:47.002ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
55362025-01-16T23:35:47.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55372025-01-16T23:35:47.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55382025-01-16T23:35:47.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55392025-01-16T23:35:47.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55402025-01-16T23:35:47.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55412025-01-16T23:35:47.005ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55422025-01-16T23:35:47.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55432025-01-16T23:35:47.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.867824ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55442025-01-16T23:35:47.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55452025-01-16T23:35:47.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55462025-01-16T23:35:47.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55472025-01-16T23:35:47.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55482025-01-16T23:35:47.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55492025-01-16T23:35:47.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55502025-01-16T23:35:47.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
55512025-01-16T23:35:47.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55522025-01-16T23:35:47.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55532025-01-16T23:35:47.024ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
55542025-01-16T23:35:47.024ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.816239ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
55552025-01-16T23:35:47.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b3ae6645-62ec-4145-bed6-783b323b96fe roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55562025-01-16T23:35:47.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b3ae6645-62ec-4145-bed6-783b323b96fe resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55572025-01-16T23:35:47.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b3ae6645-62ec-4145-bed6-783b323b96fe response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55582025-01-16T23:35:48.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aa612a00-60be-4e33-8341-3fdd2eeca644 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55592025-01-16T23:35:48.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aa612a00-60be-4e33-8341-3fdd2eeca644 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55602025-01-16T23:35:48.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aa612a00-60be-4e33-8341-3fdd2eeca644 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55612025-01-16T23:35:49.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b7b9fd5b-c407-4e5e-91a5-c1a5b46ad727 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55622025-01-16T23:35:49.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b7b9fd5b-c407-4e5e-91a5-c1a5b46ad727 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55632025-01-16T23:35:49.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b7b9fd5b-c407-4e5e-91a5-c1a5b46ad727 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55642025-01-16T23:35:50.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 43c1d2cf-d13d-4f1d-be7b-daec6270463e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55652025-01-16T23:35:50.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 43c1d2cf-d13d-4f1d-be7b-daec6270463e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55662025-01-16T23:35:50.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 43c1d2cf-d13d-4f1d-be7b-daec6270463e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55672025-01-16T23:35:51.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a6054289-8ebf-4a8c-8659-ef7afa8a558a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55682025-01-16T23:35:51.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a6054289-8ebf-4a8c-8659-ef7afa8a558a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55692025-01-16T23:35:51.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a6054289-8ebf-4a8c-8659-ef7afa8a558a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55702025-01-16T23:35:52.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 38424512-e535-45cd-8f73-d1ae5d938ee3 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55712025-01-16T23:35:52.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 38424512-e535-45cd-8f73-d1ae5d938ee3 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55722025-01-16T23:35:52.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 38424512-e535-45cd-8f73-d1ae5d938ee3 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55732025-01-16T23:35:53.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 75d53fd5-3c5e-4b20-b734-4a6db1c28f9e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55742025-01-16T23:35:53.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 75d53fd5-3c5e-4b20-b734-4a6db1c28f9e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55752025-01-16T23:35:53.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 75d53fd5-3c5e-4b20-b734-4a6db1c28f9e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55762025-01-16T23:35:55.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4e1f4f75-69dd-425a-854d-012f149d598f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55772025-01-16T23:35:55.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4e1f4f75-69dd-425a-854d-012f149d598f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55782025-01-16T23:35:55.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4e1f4f75-69dd-425a-854d-012f149d598f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55792025-01-16T23:35:55.733ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 570 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 1b5c7957-a25f-4b79-9711-5eaffcca666e response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
55802025-01-16T23:35:56.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e0c1c0ce-a653-4c27-b36c-5f9be4c21f27 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55812025-01-16T23:35:56.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e0c1c0ce-a653-4c27-b36c-5f9be4c21f27 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55822025-01-16T23:35:56.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e0c1c0ce-a653-4c27-b36c-5f9be4c21f27 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
55832025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
55842025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55852025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
55862025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55872025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
55882025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
55892025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55902025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
55912025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55922025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
55932025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55942025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
55952025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
55962025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55972025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
55982025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55992025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56002025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
56012025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56022025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
56032025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
56042025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56052025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
56062025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
56072025-01-16T23:35:57.002ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
56082025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56092025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56102025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
56112025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56122025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56132025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56142025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56152025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56162025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56172025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56182025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56192025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56202025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56212025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56222025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56232025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56242025-01-16T23:35:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56252025-01-16T23:35:57.003ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
56262025-01-16T23:35:57.003ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
56272025-01-16T23:35:57.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
56282025-01-16T23:35:57.003ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
56292025-01-16T23:35:57.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56302025-01-16T23:35:57.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
56312025-01-16T23:35:57.003ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
56322025-01-16T23:35:57.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56332025-01-16T23:35:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
56342025-01-16T23:35:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56352025-01-16T23:35:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
56362025-01-16T23:35:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56372025-01-16T23:35:57.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56382025-01-16T23:35:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56392025-01-16T23:35:57.004ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56402025-01-16T23:35:57.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56412025-01-16T23:35:57.005ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.258862ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56422025-01-16T23:35:57.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56432025-01-16T23:35:57.006ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56442025-01-16T23:35:57.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
56452025-01-16T23:35:57.007ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56462025-01-16T23:35:57.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56472025-01-16T23:35:57.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
56482025-01-16T23:35:57.008ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56492025-01-16T23:35:57.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56502025-01-16T23:35:57.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56512025-01-16T23:35:57.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56522025-01-16T23:35:57.008ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56532025-01-16T23:35:57.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56542025-01-16T23:35:57.008ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56552025-01-16T23:35:57.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56562025-01-16T23:35:57.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56572025-01-16T23:35:57.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56582025-01-16T23:35:57.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56592025-01-16T23:35:57.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56602025-01-16T23:35:57.012ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1665, tv_nsec: 326549426 } })
56612025-01-16T23:35:57.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56622025-01-16T23:35:57.012ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
56632025-01-16T23:35:57.013ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1665, tv_nsec: 327823850 } })
56642025-01-16T23:35:57.013ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
56652025-01-16T23:35:57.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
56662025-01-16T23:35:57.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56672025-01-16T23:35:57.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56682025-01-16T23:35:57.019ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1665, tv_nsec: 333758654 } })
56692025-01-16T23:35:57.019ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
56702025-01-16T23:35:57.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56712025-01-16T23:35:57.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56722025-01-16T23:35:57.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56732025-01-16T23:35:57.021ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56742025-01-16T23:35:57.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56752025-01-16T23:35:57.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56762025-01-16T23:35:57.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56772025-01-16T23:35:57.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56782025-01-16T23:35:57.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56792025-01-16T23:35:57.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
56802025-01-16T23:35:57.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56812025-01-16T23:35:57.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56822025-01-16T23:35:57.054ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
56832025-01-16T23:35:57.054ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.883546ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
56842025-01-16T23:35:57.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56852025-01-16T23:35:57.060ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56862025-01-16T23:35:57.060ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
56872025-01-16T23:35:57.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56882025-01-16T23:35:57.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56892025-01-16T23:35:57.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
56902025-01-16T23:35:57.061ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56912025-01-16T23:35:57.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bf4f0191-f6dd-481b-a3c2-6d58f270ec86 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
56922025-01-16T23:35:57.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56932025-01-16T23:35:57.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bf4f0191-f6dd-481b-a3c2-6d58f270ec86 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
56942025-01-16T23:35:57.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56952025-01-16T23:35:57.063ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.483722ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
56962025-01-16T23:35:57.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56972025-01-16T23:35:57.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bf4f0191-f6dd-481b-a3c2-6d58f270ec86 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
56982025-01-16T23:35:57.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.795797ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56992025-01-16T23:35:57.066ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57002025-01-16T23:35:57.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57012025-01-16T23:35:57.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57022025-01-16T23:35:57.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57032025-01-16T23:35:57.067ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.433757ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
57042025-01-16T23:35:57.068ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57052025-01-16T23:35:57.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57062025-01-16T23:35:57.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57072025-01-16T23:35:57.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57082025-01-16T23:35:57.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57092025-01-16T23:35:57.070ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57102025-01-16T23:35:57.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
57112025-01-16T23:35:57.070ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57122025-01-16T23:35:57.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57132025-01-16T23:35:57.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57142025-01-16T23:35:57.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.831891ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57152025-01-16T23:35:57.074ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57162025-01-16T23:35:57.076ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
57172025-01-16T23:35:57.076ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 73.908349ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
57182025-01-16T23:35:57.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57192025-01-16T23:35:57.077ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57202025-01-16T23:35:57.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57212025-01-16T23:35:57.082ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57222025-01-16T23:35:57.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57232025-01-16T23:35:57.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57242025-01-16T23:35:57.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57252025-01-16T23:35:57.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57262025-01-16T23:35:57.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
57272025-01-16T23:35:57.093ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57282025-01-16T23:35:57.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57292025-01-16T23:35:57.095ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 93.809412ms iteration = 24 status = 0
57302025-01-16T23:35:57.101ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57312025-01-16T23:35:57.101ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
57322025-01-16T23:35:57.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57332025-01-16T23:35:57.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57342025-01-16T23:35:57.102ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
57352025-01-16T23:35:57.102ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57362025-01-16T23:35:57.102ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9376155e-619d-44e0-81ac-c8e510608117", "content-length": "26", "date": "Thu, 16 Jan 2025 23:35:56 GMT"} })
57372025-01-16T23:35:57.102ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57382025-01-16T23:35:57.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 101.110061ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
57392025-01-16T23:35:57.104ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57402025-01-16T23:35:57.104ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
57412025-01-16T23:35:57.104ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 102.807224ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
57422025-01-16T23:35:57.105ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 102.088461ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57432025-01-16T23:35:57.129ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57442025-01-16T23:35:57.129ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
57452025-01-16T23:35:57.129ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 127.508669ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
57462025-01-16T23:35:57.139ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57472025-01-16T23:35:57.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57482025-01-16T23:35:57.178ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 176.056821ms iteration = 27 status = {"physical_disks_added":0}
57492025-01-16T23:35:57.181ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57502025-01-16T23:35:57.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57512025-01-16T23:35:57.183ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57522025-01-16T23:35:57.185ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57532025-01-16T23:35:57.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57542025-01-16T23:35:57.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57552025-01-16T23:35:57.187ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57562025-01-16T23:35:57.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57572025-01-16T23:35:57.189ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57582025-01-16T23:35:57.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57592025-01-16T23:35:57.197ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
57602025-01-16T23:35:57.197ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57612025-01-16T23:35:57.197ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ebaf69c-f675-4afd-a79f-233adaa0567d", "content-length": "26", "date": "Thu, 16 Jan 2025 23:35:56 GMT"} })
57622025-01-16T23:35:57.198ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57632025-01-16T23:35:57.199ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57642025-01-16T23:35:57.231ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
57652025-01-16T23:35:57.231ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57662025-01-16T23:35:57.232ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 229.799143ms iteration = 24 status = {}
57672025-01-16T23:35:57.233ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
57682025-01-16T23:35:57.233ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57692025-01-16T23:35:57.233ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cae242b3-c0d5-43c5-bcca-44e388011586", "content-length": "26", "date": "Thu, 16 Jan 2025 23:35:56 GMT"} })
57702025-01-16T23:35:57.233ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57712025-01-16T23:35:57.234ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f900fe7-2ed2-4d5c-8126-842ae53e11ce", "content-length": "372", "date": "Thu, 16 Jan 2025 23:35:57 GMT"} })
57722025-01-16T23:35:57.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57732025-01-16T23:35:57.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57742025-01-16T23:35:57.235ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
57752025-01-16T23:35:57.284ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
57762025-01-16T23:35:57.284ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
57772025-01-16T23:35:57.285ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "95cbc21c-a8e9-4af3-ba67-1b0894e48d95", "date": "Thu, 16 Jan 2025 23:35:57 GMT"} })
57782025-01-16T23:35:57.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57792025-01-16T23:35:57.285ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
57802025-01-16T23:35:57.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57812025-01-16T23:35:57.285ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cde8181c-aff8-4d9c-b74e-af781365fb1d", "content-length": "1", "date": "Thu, 16 Jan 2025 23:35:56 GMT"} })
57822025-01-16T23:35:57.286ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57832025-01-16T23:35:57.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57842025-01-16T23:35:57.287ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57852025-01-16T23:35:57.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57862025-01-16T23:35:57.289ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 287.337709ms iteration = 24 status = null
57872025-01-16T23:35:57.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57882025-01-16T23:35:57.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57892025-01-16T23:35:57.348ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57902025-01-16T23:35:57.348ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fe8fa1a-f54a-4316-b475-f47016ca5f97", "content-length": "691", "date": "Thu, 16 Jan 2025 23:35:57 GMT"} })
57912025-01-16T23:35:57.348ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
57922025-01-16T23:35:57.348ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
57932025-01-16T23:35:57.348ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
57942025-01-16T23:35:57.350ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 348.231938ms iteration = 24 status = {}
57952025-01-16T23:35:57.351ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57962025-01-16T23:35:57.351ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57972025-01-16T23:35:57.352ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "814202df-ae36-4655-a14d-04a82382439a", "date": "Thu, 16 Jan 2025 23:35:57 GMT"} })
57982025-01-16T23:35:57.353ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 351.641124ms iteration = 24 status = {}
57992025-01-16T23:35:57.382ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58002025-01-16T23:35:57.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58012025-01-16T23:35:57.385ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
58022025-01-16T23:35:57.385ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58032025-01-16T23:35:57.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58042025-01-16T23:35:57.396ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
58052025-01-16T23:35:57.396ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "23a8d2d6-0838-4d14-8594-e1cf27c1c634", "content-length": "134", "date": "Thu, 16 Jan 2025 23:35:56 GMT"} })
58062025-01-16T23:35:57.396ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
58072025-01-16T23:35:57.396ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
58082025-01-16T23:35:57.396ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
58092025-01-16T23:35:57.396ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
58102025-01-16T23:35:57.396ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58112025-01-16T23:35:57.396ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58122025-01-16T23:35:57.396ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58132025-01-16T23:35:57.396ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58142025-01-16T23:35:57.396ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58152025-01-16T23:35:57.396ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58162025-01-16T23:35:57.397ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
58172025-01-16T23:35:57.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58182025-01-16T23:35:57.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58192025-01-16T23:35:57.399ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
58202025-01-16T23:35:57.399ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "722c56b5-cfa1-427e-8d6f-1584ea1b9d79", "content-length": "2", "date": "Thu, 16 Jan 2025 23:35:56 GMT"} })
58212025-01-16T23:35:57.399ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
58222025-01-16T23:35:57.399ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b7aded1-3274-4718-b3f9-b781def1ace5", "content-length": "52", "date": "Thu, 16 Jan 2025 23:35:56 GMT"} })
58232025-01-16T23:35:57.399ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
58242025-01-16T23:35:57.399ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
58252025-01-16T23:35:57.500ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9fe81701-de25-4f75-9057-56762000bbd4", "date": "Thu, 16 Jan 2025 23:35:57 GMT"} })
58262025-01-16T23:35:57.500ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
58272025-01-16T23:35:57.500ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
58282025-01-16T23:35:57.500ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dd295d0-753c-42ac-804d-a55519e4d1a0", "content-length": "682", "date": "Thu, 16 Jan 2025 23:35:57 GMT"} })
58292025-01-16T23:35:57.501ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58302025-01-16T23:35:57.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58312025-01-16T23:35:57.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58322025-01-16T23:35:57.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58332025-01-16T23:35:57.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58342025-01-16T23:35:57.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58352025-01-16T23:35:57.510ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58362025-01-16T23:35:57.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58372025-01-16T23:35:57.516ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 514.801137ms iteration = 24 status = {}
58382025-01-16T23:35:58.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c8d689d6-0314-4aa3-822f-c8cbccdc5892 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58392025-01-16T23:35:58.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c8d689d6-0314-4aa3-822f-c8cbccdc5892 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58402025-01-16T23:35:58.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c8d689d6-0314-4aa3-822f-c8cbccdc5892 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58412025-01-16T23:35:59.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4bd93904-5ceb-4ffb-9693-304be27f7955 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58422025-01-16T23:35:59.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4bd93904-5ceb-4ffb-9693-304be27f7955 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58432025-01-16T23:35:59.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4bd93904-5ceb-4ffb-9693-304be27f7955 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58442025-01-16T23:36:00.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e39ab794-59d3-4e79-902a-af765228751c roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58452025-01-16T23:36:00.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e39ab794-59d3-4e79-902a-af765228751c resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58462025-01-16T23:36:00.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e39ab794-59d3-4e79-902a-af765228751c response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58472025-01-16T23:36:01.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c85861d6-5fc7-4c1b-9960-ab3d46d02c90 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58482025-01-16T23:36:01.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c85861d6-5fc7-4c1b-9960-ab3d46d02c90 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58492025-01-16T23:36:01.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c85861d6-5fc7-4c1b-9960-ab3d46d02c90 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58502025-01-16T23:36:02.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 73c0ffec-7e41-42d0-bdd0-8cec6300ed54 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58512025-01-16T23:36:02.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 73c0ffec-7e41-42d0-bdd0-8cec6300ed54 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58522025-01-16T23:36:02.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 73c0ffec-7e41-42d0-bdd0-8cec6300ed54 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58532025-01-16T23:36:03.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e42c43b8-4a9e-4811-b3ab-39bf035083fc roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58542025-01-16T23:36:03.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e42c43b8-4a9e-4811-b3ab-39bf035083fc resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58552025-01-16T23:36:03.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e42c43b8-4a9e-4811-b3ab-39bf035083fc response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58562025-01-16T23:36:04.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e49a5615-c060-426b-a2d8-7d44a98fffb9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58572025-01-16T23:36:04.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e49a5615-c060-426b-a2d8-7d44a98fffb9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58582025-01-16T23:36:04.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e49a5615-c060-426b-a2d8-7d44a98fffb9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58592025-01-16T23:36:05.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6ea23b3f-3ef4-42b6-bb5a-26bb4b023298 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58602025-01-16T23:36:05.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6ea23b3f-3ef4-42b6-bb5a-26bb4b023298 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58612025-01-16T23:36:05.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6ea23b3f-3ef4-42b6-bb5a-26bb4b023298 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58622025-01-16T23:36:05.733ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 559 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = d6e7a14e-1d0b-48d1-a054-e62e72ec16a9 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
58632025-01-16T23:36:06.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1197a29a-ee07-4003-a268-41a8e0977932 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58642025-01-16T23:36:06.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1197a29a-ee07-4003-a268-41a8e0977932 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58652025-01-16T23:36:06.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1197a29a-ee07-4003-a268-41a8e0977932 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58662025-01-16T23:36:07.002ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
58672025-01-16T23:36:07.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58682025-01-16T23:36:07.002ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
58692025-01-16T23:36:07.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58702025-01-16T23:36:07.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58712025-01-16T23:36:07.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58722025-01-16T23:36:07.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58732025-01-16T23:36:07.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58742025-01-16T23:36:07.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58752025-01-16T23:36:07.005ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.528308ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58762025-01-16T23:36:07.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58772025-01-16T23:36:07.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58782025-01-16T23:36:07.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58792025-01-16T23:36:07.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58802025-01-16T23:36:07.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58812025-01-16T23:36:07.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58822025-01-16T23:36:07.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
58832025-01-16T23:36:07.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58842025-01-16T23:36:07.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58852025-01-16T23:36:07.021ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
58862025-01-16T23:36:07.021ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.957874ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
58872025-01-16T23:36:07.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 62c34a37-9a93-4588-9ea4-14649a975ef6 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58882025-01-16T23:36:07.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 62c34a37-9a93-4588-9ea4-14649a975ef6 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58892025-01-16T23:36:07.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 62c34a37-9a93-4588-9ea4-14649a975ef6 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58902025-01-16T23:36:08.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 647f80f3-edfa-4e29-908d-19d55bcc6ce5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58912025-01-16T23:36:08.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 647f80f3-edfa-4e29-908d-19d55bcc6ce5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58922025-01-16T23:36:08.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1780 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 647f80f3-edfa-4e29-908d-19d55bcc6ce5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58932025-01-16T23:36:09.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 48d906b3-c2d9-4fe6-9fa3-ae4974882c0b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58942025-01-16T23:36:09.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 48d906b3-c2d9-4fe6-9fa3-ae4974882c0b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58952025-01-16T23:36:09.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 48d906b3-c2d9-4fe6-9fa3-ae4974882c0b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58962025-01-16T23:36:10.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f6ea63b8-68d7-426f-884d-48abc3d9df5d roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58972025-01-16T23:36:10.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f6ea63b8-68d7-426f-884d-48abc3d9df5d resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58982025-01-16T23:36:10.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f6ea63b8-68d7-426f-884d-48abc3d9df5d response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
58992025-01-16T23:36:11.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6c378572-af87-4bb7-9654-69e2d37d90eb roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59002025-01-16T23:36:11.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6c378572-af87-4bb7-9654-69e2d37d90eb resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59012025-01-16T23:36:11.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6c378572-af87-4bb7-9654-69e2d37d90eb response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59022025-01-16T23:36:12.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 210b5140-f3e3-4c94-a9d2-73b676deee03 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59032025-01-16T23:36:12.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 210b5140-f3e3-4c94-a9d2-73b676deee03 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59042025-01-16T23:36:12.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 210b5140-f3e3-4c94-a9d2-73b676deee03 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59052025-01-16T23:36:13.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 721fa820-6286-4689-81a7-4d4f71ea5592 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59062025-01-16T23:36:13.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 721fa820-6286-4689-81a7-4d4f71ea5592 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59072025-01-16T23:36:13.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 721fa820-6286-4689-81a7-4d4f71ea5592 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59082025-01-16T23:36:14.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4213d1f6-1f73-4c71-acab-739340e4a1c4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59092025-01-16T23:36:14.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4213d1f6-1f73-4c71-acab-739340e4a1c4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59102025-01-16T23:36:14.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4213d1f6-1f73-4c71-acab-739340e4a1c4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59112025-01-16T23:36:15.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b951bfcc-b7a2-46b9-96cd-3eb862669675 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59122025-01-16T23:36:15.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b951bfcc-b7a2-46b9-96cd-3eb862669675 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59132025-01-16T23:36:15.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b951bfcc-b7a2-46b9-96cd-3eb862669675 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59142025-01-16T23:36:15.733ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 554 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 250bc7be-5540-4cdf-a0b2-48b1c23a1be3 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
59152025-01-16T23:36:16.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6997ec6d-a22d-484d-93ad-1450472ed8ab roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59162025-01-16T23:36:16.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6997ec6d-a22d-484d-93ad-1450472ed8ab resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59172025-01-16T23:36:16.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6997ec6d-a22d-484d-93ad-1450472ed8ab response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59182025-01-16T23:36:17.002ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
59192025-01-16T23:36:17.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59202025-01-16T23:36:17.002ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
59212025-01-16T23:36:17.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59222025-01-16T23:36:17.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59232025-01-16T23:36:17.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59242025-01-16T23:36:17.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59252025-01-16T23:36:17.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59262025-01-16T23:36:17.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59272025-01-16T23:36:17.005ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.465756ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59282025-01-16T23:36:17.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59292025-01-16T23:36:17.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59302025-01-16T23:36:17.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59312025-01-16T23:36:17.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59322025-01-16T23:36:17.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59332025-01-16T23:36:17.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59342025-01-16T23:36:17.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
59352025-01-16T23:36:17.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59362025-01-16T23:36:17.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59372025-01-16T23:36:17.021ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
59382025-01-16T23:36:17.021ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.853712ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
59392025-01-16T23:36:17.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2072c876-4241-498a-b393-bd151f6ccb62 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59402025-01-16T23:36:17.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2072c876-4241-498a-b393-bd151f6ccb62 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59412025-01-16T23:36:17.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2072c876-4241-498a-b393-bd151f6ccb62 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59422025-01-16T23:36:18.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c28bee34-2d9c-4955-8d4d-cb681ec67123 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59432025-01-16T23:36:18.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c28bee34-2d9c-4955-8d4d-cb681ec67123 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59442025-01-16T23:36:18.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c28bee34-2d9c-4955-8d4d-cb681ec67123 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59452025-01-16T23:36:19.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a653e606-d73a-45bd-bdc7-6a17f9eb3553 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59462025-01-16T23:36:19.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a653e606-d73a-45bd-bdc7-6a17f9eb3553 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59472025-01-16T23:36:19.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a653e606-d73a-45bd-bdc7-6a17f9eb3553 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59482025-01-16T23:36:20.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 97944532-ad7e-4faa-8f02-ad7378850e31 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59492025-01-16T23:36:20.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 97944532-ad7e-4faa-8f02-ad7378850e31 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59502025-01-16T23:36:20.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 97944532-ad7e-4faa-8f02-ad7378850e31 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59512025-01-16T23:36:21.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6a724383-5d37-41c4-a274-276ada1a95e0 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59522025-01-16T23:36:21.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6a724383-5d37-41c4-a274-276ada1a95e0 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59532025-01-16T23:36:21.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6a724383-5d37-41c4-a274-276ada1a95e0 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59542025-01-16T23:36:22.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = efcf6aa9-02ac-4268-98fd-e08885fa5187 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59552025-01-16T23:36:22.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = efcf6aa9-02ac-4268-98fd-e08885fa5187 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59562025-01-16T23:36:22.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = efcf6aa9-02ac-4268-98fd-e08885fa5187 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59572025-01-16T23:36:23.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0165462d-aa29-4a88-b622-bc9d57164b8b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59582025-01-16T23:36:23.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0165462d-aa29-4a88-b622-bc9d57164b8b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59592025-01-16T23:36:23.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0165462d-aa29-4a88-b622-bc9d57164b8b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59602025-01-16T23:36:24.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7681bddd-92d6-4e17-9bb0-557d4a69d80c roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59612025-01-16T23:36:24.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7681bddd-92d6-4e17-9bb0-557d4a69d80c resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59622025-01-16T23:36:24.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7681bddd-92d6-4e17-9bb0-557d4a69d80c response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59632025-01-16T23:36:25.733ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 551 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = b730adb6-a927-407c-847f-f69310897dc4 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
59642025-01-16T23:36:25.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ba0b54c2-5aa4-4cd7-bffd-ae00db44b37f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59652025-01-16T23:36:25.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ba0b54c2-5aa4-4cd7-bffd-ae00db44b37f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59662025-01-16T23:36:25.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ba0b54c2-5aa4-4cd7-bffd-ae00db44b37f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59672025-01-16T23:36:26.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cfe55662-a0c3-40cb-bc44-fa23ba0d5dd9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59682025-01-16T23:36:26.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cfe55662-a0c3-40cb-bc44-fa23ba0d5dd9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59692025-01-16T23:36:26.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cfe55662-a0c3-40cb-bc44-fa23ba0d5dd9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
59702025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
59712025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59722025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
59732025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
59742025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59752025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
59762025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
59772025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59782025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
59792025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59802025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
59812025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
59822025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
59832025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
59842025-01-16T23:36:27.002ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-16 23:26:27.002797270 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
59852025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
59862025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
59872025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
59882025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59892025-01-16T23:36:27.002ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca
59902025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
59912025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.62\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca"}
59922025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
59932025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
59942025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59952025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
59962025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
59972025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59982025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
59992025-01-16T23:36:27.002ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
60002025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
60012025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60022025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60032025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
60042025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60052025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
60062025-01-16T23:36:27.003ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
60072025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
60082025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
60092025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
60102025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60112025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60122025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
60132025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60142025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
60152025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
60162025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60172025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
60182025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
60192025-01-16T23:36:27.003ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
60202025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60212025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60222025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
60232025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60242025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
60252025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
60262025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
60272025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60282025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
60292025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
60302025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
60312025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
60322025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
60332025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
60342025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
60352025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60362025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60372025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60382025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60392025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60402025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60412025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
60422025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60432025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60442025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60452025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60462025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
60472025-01-16T23:36:27.003ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5c1ab32c-50b8-4564-bf29-e388b915cbdb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd10c057-8c9f-4db2-98b5-bcf5e0d536ba.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1695, tv_nsec: 317754577 } })
60482025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60492025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60502025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60512025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60522025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60532025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60542025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
60552025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60562025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60572025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60582025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60592025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
60602025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60612025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
60622025-01-16T23:36:27.003ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dc5f3810-93b6-44f1-815c-44411abf99ad.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1695, tv_nsec: 317860159 } })
60632025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60642025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60652025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
60662025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60672025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60682025-01-16T23:36:27.003ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60692025-01-16T23:36:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60702025-01-16T23:36:27.004ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60712025-01-16T23:36:27.004ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
60722025-01-16T23:36:27.004ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.376846ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
60732025-01-16T23:36:27.004ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
60742025-01-16T23:36:27.004ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.438107ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
60752025-01-16T23:36:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60762025-01-16T23:36:27.005ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60772025-01-16T23:36:27.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60782025-01-16T23:36:27.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60792025-01-16T23:36:27.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60802025-01-16T23:36:27.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60812025-01-16T23:36:27.006ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.064498ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60822025-01-16T23:36:27.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60832025-01-16T23:36:27.007ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60842025-01-16T23:36:27.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60852025-01-16T23:36:27.008ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1695, tv_nsec: 322385446 } })
60862025-01-16T23:36:27.008ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
60872025-01-16T23:36:27.008ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60882025-01-16T23:36:27.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60892025-01-16T23:36:27.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60902025-01-16T23:36:27.011ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60912025-01-16T23:36:27.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
60922025-01-16T23:36:27.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60932025-01-16T23:36:27.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60942025-01-16T23:36:27.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60952025-01-16T23:36:27.013ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60962025-01-16T23:36:27.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60972025-01-16T23:36:27.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60982025-01-16T23:36:27.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
60992025-01-16T23:36:27.016ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61002025-01-16T23:36:27.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61012025-01-16T23:36:27.018ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-16 23:26:27.002797270 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
61022025-01-16T23:36:27.018ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.327704ms iteration = 13 status = {"expiration":"2025-01-16T23:26:27.002797270Z","pruned":[]}
61032025-01-16T23:36:27.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61042025-01-16T23:36:27.020ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61052025-01-16T23:36:27.021ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1695, tv_nsec: 336070869 } })
61062025-01-16T23:36:27.022ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
61072025-01-16T23:36:27.022ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61082025-01-16T23:36:27.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61092025-01-16T23:36:27.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61102025-01-16T23:36:27.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61112025-01-16T23:36:27.023ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61122025-01-16T23:36:27.023ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61132025-01-16T23:36:27.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61142025-01-16T23:36:27.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61152025-01-16T23:36:27.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61162025-01-16T23:36:27.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61172025-01-16T23:36:27.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
61182025-01-16T23:36:27.025ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61192025-01-16T23:36:27.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61202025-01-16T23:36:27.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61212025-01-16T23:36:27.027ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61222025-01-16T23:36:27.027ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61232025-01-16T23:36:27.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61242025-01-16T23:36:27.029ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61252025-01-16T23:36:27.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61262025-01-16T23:36:27.029ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 26.141932ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
61272025-01-16T23:36:27.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61282025-01-16T23:36:27.030ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61292025-01-16T23:36:27.031ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 28.474497ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
61302025-01-16T23:36:27.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
61312025-01-16T23:36:27.033ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61322025-01-16T23:36:27.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61332025-01-16T23:36:27.034ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61342025-01-16T23:36:27.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61352025-01-16T23:36:27.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
61362025-01-16T23:36:27.037ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61372025-01-16T23:36:27.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61382025-01-16T23:36:27.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61392025-01-16T23:36:27.038ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61402025-01-16T23:36:27.039ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61412025-01-16T23:36:27.040ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61422025-01-16T23:36:27.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
61432025-01-16T23:36:27.040ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61442025-01-16T23:36:27.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61452025-01-16T23:36:27.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61462025-01-16T23:36:27.041ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61472025-01-16T23:36:27.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
61482025-01-16T23:36:27.044ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61492025-01-16T23:36:27.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61502025-01-16T23:36:27.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61512025-01-16T23:36:27.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61522025-01-16T23:36:27.047ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61532025-01-16T23:36:27.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61542025-01-16T23:36:27.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61552025-01-16T23:36:27.049ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61562025-01-16T23:36:27.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61572025-01-16T23:36:27.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61582025-01-16T23:36:27.052ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61592025-01-16T23:36:27.052ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61602025-01-16T23:36:27.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61612025-01-16T23:36:27.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61622025-01-16T23:36:27.053ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1695, tv_nsec: 367420081 } })
61632025-01-16T23:36:27.053ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
61642025-01-16T23:36:27.055ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61652025-01-16T23:36:27.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61662025-01-16T23:36:27.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61672025-01-16T23:36:27.055ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61682025-01-16T23:36:27.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61692025-01-16T23:36:27.058ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 56.086837ms iteration = 6 status = {"nsuccess":5}
61702025-01-16T23:36:27.060ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61712025-01-16T23:36:27.060ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.435113ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
61722025-01-16T23:36:27.061ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
61732025-01-16T23:36:27.061ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
61742025-01-16T23:36:27.061ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.063845ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
61752025-01-16T23:36:27.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
61762025-01-16T23:36:27.062ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61772025-01-16T23:36:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61782025-01-16T23:36:27.068ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.050228ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61792025-01-16T23:36:27.073ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61802025-01-16T23:36:27.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61812025-01-16T23:36:27.078ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61822025-01-16T23:36:27.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61832025-01-16T23:36:27.086ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
61842025-01-16T23:36:27.086ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
61852025-01-16T23:36:27.086ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
61862025-01-16T23:36:27.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61872025-01-16T23:36:27.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61882025-01-16T23:36:27.087ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
61892025-01-16T23:36:27.087ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
61902025-01-16T23:36:27.087ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
61912025-01-16T23:36:27.087ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61922025-01-16T23:36:27.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61932025-01-16T23:36:27.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.591953ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61942025-01-16T23:36:27.094ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61952025-01-16T23:36:27.094ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61962025-01-16T23:36:27.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61972025-01-16T23:36:27.095ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
61982025-01-16T23:36:27.095ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
61992025-01-16T23:36:27.095ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 92.422425ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
62002025-01-16T23:36:27.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
62012025-01-16T23:36:27.098ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62022025-01-16T23:36:27.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62032025-01-16T23:36:27.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62042025-01-16T23:36:27.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
62052025-01-16T23:36:27.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62062025-01-16T23:36:27.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62072025-01-16T23:36:27.109ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62082025-01-16T23:36:27.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62092025-01-16T23:36:27.147ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
62102025-01-16T23:36:27.211ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
62112025-01-16T23:36:27.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62122025-01-16T23:36:27.217ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 213.920579ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62132025-01-16T23:36:27.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62142025-01-16T23:36:27.218ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62152025-01-16T23:36:27.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62162025-01-16T23:36:27.221ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/2f241142-413f-4577-99ce-e5f36b8bb539/state
62172025-01-16T23:36:27.223ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62182025-01-16T23:36:27.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62192025-01-16T23:36:27.224ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62202025-01-16T23:36:27.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62212025-01-16T23:36:27.228ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62222025-01-16T23:36:27.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62232025-01-16T23:36:27.239ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
62242025-01-16T23:36:27.239ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 236.805419ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
62252025-01-16T23:36:27.253ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62262025-01-16T23:36:27.253ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62272025-01-16T23:36:27.253ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62282025-01-16T23:36:27.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62292025-01-16T23:36:27.254ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62302025-01-16T23:36:27.254ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62312025-01-16T23:36:27.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62322025-01-16T23:36:27.256ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62332025-01-16T23:36:27.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62342025-01-16T23:36:27.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62352025-01-16T23:36:27.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62362025-01-16T23:36:27.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
62372025-01-16T23:36:27.259ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62382025-01-16T23:36:27.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62392025-01-16T23:36:27.263ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62402025-01-16T23:36:27.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62412025-01-16T23:36:27.263ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
62422025-01-16T23:36:27.263ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 0 version = 2
62432025-01-16T23:36:27.264ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62442025-01-16T23:36:27.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62452025-01-16T23:36:27.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62462025-01-16T23:36:27.265ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62472025-01-16T23:36:27.265ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62482025-01-16T23:36:27.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62492025-01-16T23:36:27.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62502025-01-16T23:36:27.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62512025-01-16T23:36:27.268ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62522025-01-16T23:36:27.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
62532025-01-16T23:36:27.268ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62542025-01-16T23:36:27.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62552025-01-16T23:36:27.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62562025-01-16T23:36:27.269ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
62572025-01-16T23:36:27.269ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62582025-01-16T23:36:27.269ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "734197c8-81de-4be6-bfe0-6282fa3ab460", "content-length": "26", "date": "Thu, 16 Jan 2025 23:36:26 GMT"} })
62592025-01-16T23:36:27.269ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62602025-01-16T23:36:27.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62612025-01-16T23:36:27.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62622025-01-16T23:36:27.270ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 268.092859ms iteration = 25 status = 0
62632025-01-16T23:36:27.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62642025-01-16T23:36:27.271ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62652025-01-16T23:36:27.273ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 1 version = 2
62662025-01-16T23:36:27.273ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
62672025-01-16T23:36:27.273ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-16 23:25:21.695734 UTC dns_group = external generation = 2
62682025-01-16T23:36:27.273ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 270.339792ms iteration = 13 status = {"generation":2}
62692025-01-16T23:36:27.297ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62702025-01-16T23:36:27.297ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62712025-01-16T23:36:27.297ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 294.286862ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
62722025-01-16T23:36:27.299ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
62732025-01-16T23:36:27.300ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
62742025-01-16T23:36:27.300ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62752025-01-16T23:36:27.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62762025-01-16T23:36:27.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62772025-01-16T23:36:27.302ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
62782025-01-16T23:36:27.302ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 299.281438ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
62792025-01-16T23:36:27.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62802025-01-16T23:36:27.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62812025-01-16T23:36:27.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62822025-01-16T23:36:27.307ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
62832025-01-16T23:36:27.307ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
62842025-01-16T23:36:27.307ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-16 23:25:20.756297 UTC dns_group = internal generation = 1
62852025-01-16T23:36:27.307ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 304.896756ms iteration = 13 status = {"generation":1}
62862025-01-16T23:36:27.312ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 309.650417ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
62872025-01-16T23:36:27.317ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
62882025-01-16T23:36:27.317ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62892025-01-16T23:36:27.317ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
62902025-01-16T23:36:27.317ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1a118d7-4e5e-4768-86b6-8810909e6c8b", "content-length": "26", "date": "Thu, 16 Jan 2025 23:36:26 GMT"} })
62912025-01-16T23:36:27.317ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62922025-01-16T23:36:27.319ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62932025-01-16T23:36:27.325ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-16T23:24:20.471931Z, time_modified: 2025-01-16T23:24:20.471931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
62942025-01-16T23:36:27.325ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 322.80741ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]}},"default_endpoint":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
62952025-01-16T23:36:27.327ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 324.591474ms iteration = 28 status = {"physical_disks_added":0}
62962025-01-16T23:36:27.346ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
62972025-01-16T23:36:27.346ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 343.904865ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
62982025-01-16T23:36:27.347ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62992025-01-16T23:36:27.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63002025-01-16T23:36:27.371ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
63012025-01-16T23:36:27.371ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63022025-01-16T23:36:27.371ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "70107033-e8d6-4686-9c2c-ac3a515a2d64", "content-length": "26", "date": "Thu, 16 Jan 2025 23:36:26 GMT"} })
63032025-01-16T23:36:27.371ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63042025-01-16T23:36:27.374ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
63052025-01-16T23:36:27.444ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
63062025-01-16T23:36:27.444ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3c457dce-99d6-4614-8929-c52995013410", "date": "Thu, 16 Jan 2025 23:36:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63072025-01-16T23:36:27.444ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63082025-01-16T23:36:27.446ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8dbd45d0-26bc-4c57-af15-1bf7d3381020", "date": "Thu, 16 Jan 2025 23:36:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63092025-01-16T23:36:27.446ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63102025-01-16T23:36:27.447ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63112025-01-16T23:36:27.448ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 445.222511ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
63122025-01-16T23:36:27.470ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 467.510889ms iteration = 25 status = {}
63132025-01-16T23:36:27.483ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
63142025-01-16T23:36:27.483ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63152025-01-16T23:36:27.514ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63162025-01-16T23:36:27.516ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63172025-01-16T23:36:27.516ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63182025-01-16T23:36:27.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63192025-01-16T23:36:27.524ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7eb3c0f-2303-43cc-b49d-0a7358147058", "content-length": "523", "date": "Thu, 16 Jan 2025 23:36:27 GMT"} })
63202025-01-16T23:36:27.524ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63212025-01-16T23:36:27.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63222025-01-16T23:36:27.555ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63232025-01-16T23:36:27.557ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63242025-01-16T23:36:27.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63252025-01-16T23:36:27.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63262025-01-16T23:36:27.578ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {f365cf8b-ed44-4683-aef3-1e1250e19e35: {10.151.1.175: {c16b1b31-9220-4ec4-a2ab-aa48b61c67bf}, 10.151.1.176: {c16b1b31-9220-4ec4-a2ab-aa48b61c67bf}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
63272025-01-16T23:36:27.578ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
63282025-01-16T23:36:27.579ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "830d56c9-00ff-4623-ba97-403e828932a1", "date": "Thu, 16 Jan 2025 23:36:27 GMT"} })
63292025-01-16T23:36:27.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63302025-01-16T23:36:27.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63312025-01-16T23:36:27.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63322025-01-16T23:36:27.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63332025-01-16T23:36:27.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63342025-01-16T23:36:27.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63352025-01-16T23:36:27.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63362025-01-16T23:36:27.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63372025-01-16T23:36:27.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63382025-01-16T23:36:27.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63392025-01-16T23:36:27.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63402025-01-16T23:36:27.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63412025-01-16T23:36:27.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63422025-01-16T23:36:27.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63432025-01-16T23:36:27.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63442025-01-16T23:36:27.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63452025-01-16T23:36:27.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63462025-01-16T23:36:27.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63472025-01-16T23:36:27.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63482025-01-16T23:36:27.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63492025-01-16T23:36:27.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63502025-01-16T23:36:27.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63512025-01-16T23:36:27.641ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63522025-01-16T23:36:27.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63532025-01-16T23:36:27.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63542025-01-16T23:36:27.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63552025-01-16T23:36:27.644ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63562025-01-16T23:36:27.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 53828d51-c7a3-4557-b913-6b5f10d267df, lookup_type: ById(53828d51-c7a3-4557-b913-6b5f10d267df) }, key: 14cc1e33-d5c6-4b7a-bf68-a00ccde56a21, lookup_type: ById(14cc1e33-d5c6-4b7a-bf68-a00ccde56a21) }, key: 8bf21f42-6673-42d0-acd0-fae3afea37c6, lookup_type: ById(8bf21f42-6673-42d0-acd0-fae3afea37c6) }, key: 0c1ad0f6-8977-429b-a0d2-789d54a9f098, lookup_type: ById(0c1ad0f6-8977-429b-a0d2-789d54a9f098) } result = Ok(())
63572025-01-16T23:36:27.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63582025-01-16T23:36:27.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63592025-01-16T23:36:27.650ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63602025-01-16T23:36:27.650ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d97e376a-fc90-4d7b-98e8-87d11dd0801c", "content-length": "1", "date": "Thu, 16 Jan 2025 23:36:27 GMT"} })
63612025-01-16T23:36:27.652ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63622025-01-16T23:36:27.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63632025-01-16T23:36:27.661ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
63642025-01-16T23:36:27.662ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "991b1d5a-fc78-4f4e-af02-3732a89d8fc7", "date": "Thu, 16 Jan 2025 23:36:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63652025-01-16T23:36:27.662ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63662025-01-16T23:36:27.663ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "dad23a31-8af0-44a5-a9f8-4f36d7ac98bb", "date": "Thu, 16 Jan 2025 23:36:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63672025-01-16T23:36:27.663ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63682025-01-16T23:36:27.665ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1c8e1757-2430-4cad-bb79-4dd9695c3c5f", "date": "Thu, 16 Jan 2025 23:36:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63692025-01-16T23:36:27.665ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63702025-01-16T23:36:27.668ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63712025-01-16T23:36:27.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 665.307748ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
63722025-01-16T23:36:27.699ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63732025-01-16T23:36:27.699ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "52923b56-fd65-48e2-91bf-b9c82cbfec95", "content-length": "810", "date": "Thu, 16 Jan 2025 23:36:27 GMT"} })
63742025-01-16T23:36:27.699ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(3443410) }} sled = buskin
63752025-01-16T23:36:27.699ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
63762025-01-16T23:36:27.699ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
63772025-01-16T23:36:27.700ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63782025-01-16T23:36:27.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63792025-01-16T23:36:27.701ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 698.22482ms iteration = 25 status = null
63802025-01-16T23:36:27.701ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 698.891333ms iteration = 25 status = {}
63812025-01-16T23:36:27.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63822025-01-16T23:36:27.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63832025-01-16T23:36:27.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63842025-01-16T23:36:27.741ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 53828d51-c7a3-4557-b913-6b5f10d267df, lookup_type: ById(53828d51-c7a3-4557-b913-6b5f10d267df) }, key: 14cc1e33-d5c6-4b7a-bf68-a00ccde56a21, lookup_type: ById(14cc1e33-d5c6-4b7a-bf68-a00ccde56a21) }, key: 8bf21f42-6673-42d0-acd0-fae3afea37c6, lookup_type: ById(8bf21f42-6673-42d0-acd0-fae3afea37c6) }, key: 0c1ad0f6-8977-429b-a0d2-789d54a9f098, lookup_type: ById(0c1ad0f6-8977-429b-a0d2-789d54a9f098) } result = Ok(())
63852025-01-16T23:36:27.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63862025-01-16T23:36:27.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63872025-01-16T23:36:27.745ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63882025-01-16T23:36:27.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63892025-01-16T23:36:27.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63902025-01-16T23:36:27.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63912025-01-16T23:36:27.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63922025-01-16T23:36:27.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63932025-01-16T23:36:27.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63942025-01-16T23:36:27.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63952025-01-16T23:36:27.750ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
63962025-01-16T23:36:27.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63972025-01-16T23:36:27.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63982025-01-16T23:36:27.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63992025-01-16T23:36:27.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64002025-01-16T23:36:27.753ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64012025-01-16T23:36:27.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64022025-01-16T23:36:27.755ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64032025-01-16T23:36:27.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64042025-01-16T23:36:27.756ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64052025-01-16T23:36:27.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64062025-01-16T23:36:27.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64072025-01-16T23:36:27.759ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64082025-01-16T23:36:27.760ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "56a8995f-1a6f-41a4-961e-940056a86922", "content-length": "134", "date": "Thu, 16 Jan 2025 23:36:27 GMT"} })
64092025-01-16T23:36:27.760ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64102025-01-16T23:36:27.760ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
64112025-01-16T23:36:27.760ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64122025-01-16T23:36:27.760ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64132025-01-16T23:36:27.760ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64142025-01-16T23:36:27.760ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64152025-01-16T23:36:27.760ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64162025-01-16T23:36:27.760ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64172025-01-16T23:36:27.760ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64182025-01-16T23:36:27.760ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64192025-01-16T23:36:27.760ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
64202025-01-16T23:36:27.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64212025-01-16T23:36:27.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64222025-01-16T23:36:27.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 53828d51-c7a3-4557-b913-6b5f10d267df, lookup_type: ById(53828d51-c7a3-4557-b913-6b5f10d267df) }, key: 14cc1e33-d5c6-4b7a-bf68-a00ccde56a21, lookup_type: ById(14cc1e33-d5c6-4b7a-bf68-a00ccde56a21) }, key: 8bf21f42-6673-42d0-acd0-fae3afea37c6, lookup_type: ById(8bf21f42-6673-42d0-acd0-fae3afea37c6) }, key: 1d2d13f8-e057-441d-bdda-66b1994d92b0, lookup_type: ByName("default") } result = Ok(())
64232025-01-16T23:36:27.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64242025-01-16T23:36:27.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64252025-01-16T23:36:27.762ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64262025-01-16T23:36:27.762ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "04ed562e-35aa-4e8d-9606-a5714d1ea8b3", "content-length": "2", "date": "Thu, 16 Jan 2025 23:36:27 GMT"} })
64272025-01-16T23:36:27.762ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64282025-01-16T23:36:27.762ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc7ee81c-dbd6-4dcb-a3bf-99997f61aaa2", "content-length": "52", "date": "Thu, 16 Jan 2025 23:36:27 GMT"} })
64292025-01-16T23:36:27.762ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
64302025-01-16T23:36:27.762ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64312025-01-16T23:36:27.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64322025-01-16T23:36:27.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64332025-01-16T23:36:27.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64342025-01-16T23:36:27.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64352025-01-16T23:36:27.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64362025-01-16T23:36:27.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64372025-01-16T23:36:27.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64382025-01-16T23:36:27.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64392025-01-16T23:36:27.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64402025-01-16T23:36:27.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64412025-01-16T23:36:27.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64422025-01-16T23:36:27.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64432025-01-16T23:36:27.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64442025-01-16T23:36:27.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 53828d51-c7a3-4557-b913-6b5f10d267df, lookup_type: ById(53828d51-c7a3-4557-b913-6b5f10d267df) }, key: 14cc1e33-d5c6-4b7a-bf68-a00ccde56a21, lookup_type: ById(14cc1e33-d5c6-4b7a-bf68-a00ccde56a21) }, key: 8bf21f42-6673-42d0-acd0-fae3afea37c6, lookup_type: ById(8bf21f42-6673-42d0-acd0-fae3afea37c6) }, key: c16b1b31-9220-4ec4-a2ab-aa48b61c67bf, lookup_type: ByName("default") } result = Ok(())
64452025-01-16T23:36:27.807ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64462025-01-16T23:36:27.807ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64472025-01-16T23:36:27.857ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "27ba5824-bf51-424b-bf4d-d13af59c3577", "date": "Thu, 16 Jan 2025 23:36:27 GMT"} })
64482025-01-16T23:36:27.857ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
64492025-01-16T23:36:27.857ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64502025-01-16T23:36:27.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 691257de-3b31-42dd-9dcb-2cb3b56fc644 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64512025-01-16T23:36:27.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 691257de-3b31-42dd-9dcb-2cb3b56fc644 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64522025-01-16T23:36:27.858ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "26ebcc2e-b150-42af-bac5-0cfd1cef0c6f", "content-length": "682", "date": "Thu, 16 Jan 2025 23:36:27 GMT"} })
64532025-01-16T23:36:27.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64542025-01-16T23:36:27.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64552025-01-16T23:36:27.858ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b45ac1ef-dd18-4351-96fb-d7fd2fd9b66f", "date": "Thu, 16 Jan 2025 23:36:27 GMT"} })
64562025-01-16T23:36:27.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 691257de-3b31-42dd-9dcb-2cb3b56fc644 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64572025-01-16T23:36:27.860ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 857.869406ms iteration = 25 status = {}
64582025-01-16T23:36:27.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64592025-01-16T23:36:27.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64602025-01-16T23:36:27.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64612025-01-16T23:36:27.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64622025-01-16T23:36:27.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64632025-01-16T23:36:27.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64642025-01-16T23:36:27.878ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 875.139947ms iteration = 25 status = {}
64652025-01-16T23:36:28.622ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/2f241142-413f-4577-99ce-e5f36b8bb539/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6b9b699-ba46-4b53-941f-23e5232221cb", "content-length": "131", "date": "Thu, 16 Jan 2025 23:36:28 GMT"} })
64662025-01-16T23:36:28.631ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 sled_id = 198593b5-c3c6-4ef5-879a-52095a2ef511 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-16T23:36:20.181236294Z }, migration_in: None, migration_out: None } vmm_id = 2f241142-413f-4577-99ce-e5f36b8bb539
64672025-01-16T23:36:28.631ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2077 instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2f241142-413f-4577-99ce-e5f36b8bb539 sled_id = 198593b5-c3c6-4ef5-879a-52095a2ef511 vmm_id = 2f241142-413f-4577-99ce-e5f36b8bb539 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-16T23:36:20.181236294Z }
64682025-01-16T23:36:28.631ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 roles = RoleSet { roles: {} } sled_id = 198593b5-c3c6-4ef5-879a-52095a2ef511 vmm_id = 2f241142-413f-4577-99ce-e5f36b8bb539
64692025-01-16T23:36:28.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 resource = Database result = Ok(()) sled_id = 198593b5-c3c6-4ef5-879a-52095a2ef511 vmm_id = 2f241142-413f-4577-99ce-e5f36b8bb539
64702025-01-16T23:36:28.641ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2f241142-413f-4577-99ce-e5f36b8bb539 remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7c89cbdd-37a1-4301-b614-e2294e6dfbec uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-16T23:36:28.622955576Z }
64712025-01-16T23:36:28.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7c89cbdd-37a1-4301-b614-e2294e6dfbec roles = RoleSet { roles: {} } uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
64722025-01-16T23:36:28.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7c89cbdd-37a1-4301-b614-e2294e6dfbec resource = Database result = Ok(()) uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
64732025-01-16T23:36:28.671ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
64742025-01-16T23:36:28.673ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 1.6709043s iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
64752025-01-16T23:36:28.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65106 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7c89cbdd-37a1-4301-b614-e2294e6dfbec response_code = 204 uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
64762025-01-16T23:36:28.690ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2f241142-413f-4577-99ce-e5f36b8bb539 remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0b824c3b-df49-4461-b3bc-04aba8142d6c uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-16T23:36:28.690628235Z }
64772025-01-16T23:36:28.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0b824c3b-df49-4461-b3bc-04aba8142d6c roles = RoleSet { roles: {} } uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
64782025-01-16T23:36:28.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0b824c3b-df49-4461-b3bc-04aba8142d6c resource = Database result = Ok(()) uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
64792025-01-16T23:36:28.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15589 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0b824c3b-df49-4461-b3bc-04aba8142d6c response_code = 204 uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
64802025-01-16T23:36:28.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 05fa2d2f-4ac5-42f2-866c-85a3cdc79b83 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64812025-01-16T23:36:28.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 05fa2d2f-4ac5-42f2-866c-85a3cdc79b83 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64822025-01-16T23:36:28.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 05fa2d2f-4ac5-42f2-866c-85a3cdc79b83 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64832025-01-16T23:36:29.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1471df59-3429-4076-b60c-f4f5e3b2abfe roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64842025-01-16T23:36:29.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1471df59-3429-4076-b60c-f4f5e3b2abfe resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64852025-01-16T23:36:29.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1471df59-3429-4076-b60c-f4f5e3b2abfe response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64862025-01-16T23:36:31.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 98731362-11c1-4512-90cb-7a29e838ad12 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64872025-01-16T23:36:31.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 98731362-11c1-4512-90cb-7a29e838ad12 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64882025-01-16T23:36:31.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 98731362-11c1-4512-90cb-7a29e838ad12 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64892025-01-16T23:36:32.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2da806b5-2ebb-4948-ad57-ebc30ca051aa roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64902025-01-16T23:36:32.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2da806b5-2ebb-4948-ad57-ebc30ca051aa resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64912025-01-16T23:36:32.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2da806b5-2ebb-4948-ad57-ebc30ca051aa response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64922025-01-16T23:36:33.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c2d8afb9-0e82-4ef1-bf6c-a2d45a639529 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64932025-01-16T23:36:33.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c2d8afb9-0e82-4ef1-bf6c-a2d45a639529 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64942025-01-16T23:36:33.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c2d8afb9-0e82-4ef1-bf6c-a2d45a639529 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64952025-01-16T23:36:34.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 75a041f2-5e4a-4a26-abad-fb17c2d787dc roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64962025-01-16T23:36:34.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 75a041f2-5e4a-4a26-abad-fb17c2d787dc resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64972025-01-16T23:36:34.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 75a041f2-5e4a-4a26-abad-fb17c2d787dc response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64982025-01-16T23:36:35.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9fbd7ba1-72d1-4328-b9c7-70209a5ae1dc roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
64992025-01-16T23:36:35.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9fbd7ba1-72d1-4328-b9c7-70209a5ae1dc resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65002025-01-16T23:36:35.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9fbd7ba1-72d1-4328-b9c7-70209a5ae1dc response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65012025-01-16T23:36:35.734ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 767 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 0791b163-04ef-4434-b0df-754573b52219 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
65022025-01-16T23:36:36.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fe60745e-70f5-469c-826a-20f9806547ba roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65032025-01-16T23:36:36.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fe60745e-70f5-469c-826a-20f9806547ba resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65042025-01-16T23:36:36.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fe60745e-70f5-469c-826a-20f9806547ba response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65052025-01-16T23:36:37.002ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
65062025-01-16T23:36:37.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65072025-01-16T23:36:37.002ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
65082025-01-16T23:36:37.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65092025-01-16T23:36:37.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65102025-01-16T23:36:37.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65112025-01-16T23:36:37.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65122025-01-16T23:36:37.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65132025-01-16T23:36:37.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65142025-01-16T23:36:37.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65152025-01-16T23:36:37.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65162025-01-16T23:36:37.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65172025-01-16T23:36:37.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65182025-01-16T23:36:37.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
65192025-01-16T23:36:37.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65202025-01-16T23:36:37.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65212025-01-16T23:36:37.025ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
65222025-01-16T23:36:37.025ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.342118ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
65232025-01-16T23:36:37.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65242025-01-16T23:36:37.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65252025-01-16T23:36:37.055ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.430436ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65262025-01-16T23:36:37.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = db34c92a-2044-41c7-9872-81c40a972a7d roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65272025-01-16T23:36:37.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = db34c92a-2044-41c7-9872-81c40a972a7d resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65282025-01-16T23:36:37.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = db34c92a-2044-41c7-9872-81c40a972a7d response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65292025-01-16T23:36:38.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 454e3caf-d4d9-4ccf-b390-f3880d0d00bb roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65302025-01-16T23:36:38.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 454e3caf-d4d9-4ccf-b390-f3880d0d00bb resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65312025-01-16T23:36:38.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 454e3caf-d4d9-4ccf-b390-f3880d0d00bb response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65322025-01-16T23:36:38.625ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2f241142-413f-4577-99ce-e5f36b8bb539 remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2fb5439b-04e9-4a08-a36c-f2436da22d75 uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-16T23:36:38.624773289Z }
65332025-01-16T23:36:38.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2fb5439b-04e9-4a08-a36c-f2436da22d75 roles = RoleSet { roles: {} } uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65342025-01-16T23:36:38.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2fb5439b-04e9-4a08-a36c-f2436da22d75 resource = Database result = Ok(()) uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65352025-01-16T23:36:38.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46637 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2fb5439b-04e9-4a08-a36c-f2436da22d75 response_code = 204 uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65362025-01-16T23:36:39.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1a9e9729-b844-4575-b9b8-47921c9f1988 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65372025-01-16T23:36:39.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1a9e9729-b844-4575-b9b8-47921c9f1988 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65382025-01-16T23:36:39.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1a9e9729-b844-4575-b9b8-47921c9f1988 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65392025-01-16T23:36:40.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fa221f0a-2dc9-47a6-b091-fd9435133247 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65402025-01-16T23:36:40.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fa221f0a-2dc9-47a6-b091-fd9435133247 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65412025-01-16T23:36:40.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fa221f0a-2dc9-47a6-b091-fd9435133247 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65422025-01-16T23:36:41.102ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2f241142-413f-4577-99ce-e5f36b8bb539 remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-16T23:36:41.102044654Z }
65432025-01-16T23:36:41.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba roles = RoleSet { roles: {} } uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65442025-01-16T23:36:41.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba resource = Database result = Ok(()) uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65452025-01-16T23:36:41.116ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 2f241142-413f-4577-99ce-e5f36b8bb539 remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539 vmm_needs_update = true
65462025-01-16T23:36:41.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba roles = RoleSet { roles: {} } uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65472025-01-16T23:36:41.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba resource = Database result = Ok(()) uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65482025-01-16T23:36:41.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba roles = RoleSet { roles: {} } uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65492025-01-16T23:36:41.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba resource = Database result = Ok(()) uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65502025-01-16T23:36:41.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba roles = RoleSet { roles: {} } uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65512025-01-16T23:36:41.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba resource = Database result = Ok(()) uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65522025-01-16T23:36:41.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba roles = RoleSet { roles: {} } uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65532025-01-16T23:36:41.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba resource = Database result = Ok(()) uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65542025-01-16T23:36:41.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba roles = RoleSet { roles: {} } uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65552025-01-16T23:36:41.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba resource = Database result = Ok(()) uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65562025-01-16T23:36:41.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba roles = RoleSet { roles: {} } uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65572025-01-16T23:36:41.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba resource = Database result = Ok(()) uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65582025-01-16T23:36:41.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65592025-01-16T23:36:41.130ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 53828d51-c7a3-4557-b913-6b5f10d267df, lookup_type: ById(53828d51-c7a3-4557-b913-6b5f10d267df) }, key: 14cc1e33-d5c6-4b7a-bf68-a00ccde56a21, lookup_type: ById(14cc1e33-d5c6-4b7a-bf68-a00ccde56a21) }, key: 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13, lookup_type: ById(7f99f0f0-65b1-4cc7-8391-f8886f9a2d13) } result = Ok(()) uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65602025-01-16T23:36:41.137ZINFOnexus (dropshot_internal): starting update saga for 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1544 instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-16T23:36:41.102044654Z }
65612025-01-16T23:36:41.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35571 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba response_code = 204 uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65622025-01-16T23:36:41.137ZDEBGnexus (dropshot_internal): preparing instance-update saga for 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 102ec780-33de-4d1b-8120-ab70c2912eba uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65632025-01-16T23:36:41.138ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2f241142-413f-4577-99ce-e5f36b8bb539 remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d7534332-fd9f-4123-8e32-0f39e381a35e uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-16T23:36:41.102044654Z }
65642025-01-16T23:36:41.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d7534332-fd9f-4123-8e32-0f39e381a35e roles = RoleSet { roles: {} } uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65652025-01-16T23:36:41.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d7534332-fd9f-4123-8e32-0f39e381a35e resource = Database result = Ok(()) uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65662025-01-16T23:36:41.140ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update
65672025-01-16T23:36:41.142ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"7f99f0f0-65b1-4cc7-8391-f8886f9a2d13","lookup_type":{"ById":"7f99f0f0-65b1-4cc7-8391-f8886f9a2d13"},"parent":{"key":"14cc1e33-d5c6-4b7a-bf68-a00ccde56a21","lookup_type":{"ById":"14cc1e33-d5c6-4b7a-bf68-a00ccde56a21"},"parent":{"key":"53828d51-c7a3-4557-b913-6b5f10d267df","lookup_type":{"ById":"53828d51-c7a3-4557-b913-6b5f10d267df"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
65682025-01-16T23:36:41.142ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update
65692025-01-16T23:36:41.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4363 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d7534332-fd9f-4123-8e32-0f39e381a35e response_code = 204 uri = /vmms/2f241142-413f-4577-99ce-e5f36b8bb539
65702025-01-16T23:36:41.176ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update
65712025-01-16T23:36:41.176ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
65722025-01-16T23:36:41.176ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
65732025-01-16T23:36:41.176ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33
65742025-01-16T23:36:41.184ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
65752025-01-16T23:36:41.184ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33
65762025-01-16T23:36:41.190ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
65772025-01-16T23:36:41.190ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33
65782025-01-16T23:36:41.197ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
65792025-01-16T23:36:41.197ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("003b1657-ed34-4549-aab1-8aad64168822")) node_id = 0 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33
65802025-01-16T23:36:41.203ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
65812025-01-16T23:36:41.203ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33
65822025-01-16T23:36:41.221ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update
65832025-01-16T23:36:41.225ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
65842025-01-16T23:36:41.225ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
65852025-01-16T23:36:41.228ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
65862025-01-16T23:36:41.228ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
65872025-01-16T23:36:41.229ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
65882025-01-16T23:36:41.229ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
65892025-01-16T23:36:41.231ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
65902025-01-16T23:36:41.231ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
65912025-01-16T23:36:41.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e93bf601-4821-4aa7-bebd-c6f411f05130 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65922025-01-16T23:36:41.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e93bf601-4821-4aa7-bebd-c6f411f05130 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65932025-01-16T23:36:41.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e93bf601-4821-4aa7-bebd-c6f411f05130 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
65942025-01-16T23:36:41.257ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
65952025-01-16T23:36:41.257ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
65962025-01-16T23:36:41.258ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
65972025-01-16T23:36:41.258ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
65982025-01-16T23:36:41.260ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
65992025-01-16T23:36:41.263ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 53828d51-c7a3-4557-b913-6b5f10d267df, lookup_type: ById(53828d51-c7a3-4557-b913-6b5f10d267df) }, key: 14cc1e33-d5c6-4b7a-bf68-a00ccde56a21, lookup_type: ById(14cc1e33-d5c6-4b7a-bf68-a00ccde56a21) }, key: 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13, lookup_type: ById(7f99f0f0-65b1-4cc7-8391-f8886f9a2d13) } result = Ok(()) saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
66002025-01-16T23:36:41.263ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance updater_id = 003b1657-ed34-4549-aab1-8aad64168822
66012025-01-16T23:36:41.263ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
66022025-01-16T23:36:41.263ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
66032025-01-16T23:36:41.280ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance updater_id = 003b1657-ed34-4549-aab1-8aad64168822
66042025-01-16T23:36:41.280ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
66052025-01-16T23:36:41.281ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance
66062025-01-16T23:36:41.286ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 locked_gen = Generation(Generation(2)) saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = LockInstance updater_id = 003b1657-ed34-4549-aab1-8aad64168822
66072025-01-16T23:36:41.286ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66082025-01-16T23:36:41.286ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("003b1657-ed34-4549-aab1-8aad64168822")}) node_id = 1 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33
66092025-01-16T23:36:41.293ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66102025-01-16T23:36:41.293ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33
66112025-01-16T23:36:41.315ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66122025-01-16T23:36:41.316ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66132025-01-16T23:36:41.317ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66142025-01-16T23:36:41.317ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66152025-01-16T23:36:41.319ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66162025-01-16T23:36:41.319ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66172025-01-16T23:36:41.320ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66182025-01-16T23:36:41.323ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 53828d51-c7a3-4557-b913-6b5f10d267df, lookup_type: ById(53828d51-c7a3-4557-b913-6b5f10d267df) }, key: 14cc1e33-d5c6-4b7a-bf68-a00ccde56a21, lookup_type: ById(14cc1e33-d5c6-4b7a-bf68-a00ccde56a21) }, key: 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13, lookup_type: ById(7f99f0f0-65b1-4cc7-8391-f8886f9a2d13) } result = Ok(()) saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66192025-01-16T23:36:41.323ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66202025-01-16T23:36:41.323ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66212025-01-16T23:36:41.329ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 2f241142-413f-4577-99ce-e5f36b8bb539, time_created: 2025-01-16T23:36:19.703862Z, time_deleted: None, instance_id: 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13, sled_id: 198593b5-c3c6-4ef5-879a-52095a2ef511, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-01-16T23:36:41.102044Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-01-16T23:36:16.654574Z, gen: Generation(Generation(3)), propolis_id: Some(2f241142-413f-4577-99ce-e5f36b8bb539), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(2f241142-413f-4577-99ce-e5f36b8bb539 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-01-16T23:36:41.329923561Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
66222025-01-16T23:36:41.332ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
66232025-01-16T23:36:41.334ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"7f99f0f0-65b1-4cc7-8391-f8886f9a2d13","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"2f241142-413f-4577-99ce-e5f36b8bb539"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"7f99f0f0-65b1-4cc7-8391-f8886f9a2d13","lookup_type":{"ById":"7f99f0f0-65b1-4cc7-8391-f8886f9a2d13"},"parent":{"key":"14cc1e33-d5c6-4b7a-bf68-a00ccde56a21","lookup_type":{"ById":"14cc1e33-d5c6-4b7a-bf68-a00ccde56a21"},"parent":{"key":"53828d51-c7a3-4557-b913-6b5f10d267df","lookup_type":{"ById":"53828d51-c7a3-4557-b913-6b5f10d267df"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"003b1657-ed34-4549-aab1-8aad64168822"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"14cc1e33-d5c6-4b7a-bf68-a00ccde56a21","ram_diff":1073741824},"destroy_active_vmm":"2f241142-413f-4577-99ce-e5f36b8bb539","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-01-16T23:36:41.329923561Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66242025-01-16T23:36:41.334ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
66252025-01-16T23:36:41.372ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
66262025-01-16T23:36:41.372ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66272025-01-16T23:36:41.372ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66282025-01-16T23:36:41.372ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
66292025-01-16T23:36:41.380ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66302025-01-16T23:36:41.380ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
66312025-01-16T23:36:41.384ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66322025-01-16T23:36:41.384ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
66332025-01-16T23:36:41.390ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66342025-01-16T23:36:41.390ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("e2a46568-cd73-48e3-990a-86a83923f2be")) node_id = 0 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
66352025-01-16T23:36:41.393ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66362025-01-16T23:36:41.393ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
66372025-01-16T23:36:41.401ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 parent_lock = UpdaterLock { updater_id: 003b1657-ed34-4549-aab1-8aad64168822, locked_gen: Generation(Generation(2)) } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
66382025-01-16T23:36:41.401ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = BecomeUpdater
66392025-01-16T23:36:41.401ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = BecomeUpdater
66402025-01-16T23:36:41.419ZDEBGnexus (SagaExecutor): inherited lock from 003b1657-ed34-4549-aab1-8aad64168822 to e2a46568-cd73-48e3-990a-86a83923f2be actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 003b1657-ed34-4549-aab1-8aad64168822 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = BecomeUpdater updater_id = e2a46568-cd73-48e3-990a-86a83923f2be
66412025-01-16T23:36:41.419ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
66422025-01-16T23:36:41.419ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66432025-01-16T23:36:41.419ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("e2a46568-cd73-48e3-990a-86a83923f2be")}) node_id = 1 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
66442025-01-16T23:36:41.422ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66452025-01-16T23:36:41.422ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
66462025-01-16T23:36:41.427ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66472025-01-16T23:36:41.427ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
66482025-01-16T23:36:41.433ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66492025-01-16T23:36:41.433ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
66502025-01-16T23:36:41.438ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
66512025-01-16T23:36:41.440ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13
66522025-01-16T23:36:41.440ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = UpdateNetworkConfig
66532025-01-16T23:36:41.441ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = UpdateNetworkConfig
66542025-01-16T23:36:41.444ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = UpdateNetworkConfig
66552025-01-16T23:36:41.444ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = UpdateNetworkConfig
66562025-01-16T23:36:41.450ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
66572025-01-16T23:36:41.450ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = UpdateNetworkConfig
66582025-01-16T23:36:41.451ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = UpdateNetworkConfig
66592025-01-16T23:36:41.453ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
66602025-01-16T23:36:41.453ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
66612025-01-16T23:36:41.453ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
66622025-01-16T23:36:41.454ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
66632025-01-16T23:36:41.456ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
66642025-01-16T23:36:41.456ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
66652025-01-16T23:36:41.456ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
66662025-01-16T23:36:41.462ZDEBGnexus: notifying dendrite of updates instance_id = Some(7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 (instance)) switch = switch0
66672025-01-16T23:36:41.462ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1709, tv_nsec: 776932026 } })
66682025-01-16T23:36:41.463ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1104
66692025-01-16T23:36:41.494ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
66702025-01-16T23:36:41.494ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66712025-01-16T23:36:41.495ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "95bd4f1f-8321-4836-9d66-2efd04b05cac", "content-length": "26", "date": "Thu, 16 Jan 2025 23:36:41 GMT"} })
66722025-01-16T23:36:41.495ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66732025-01-16T23:36:41.495ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66742025-01-16T23:36:41.525ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
66752025-01-16T23:36:41.525ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4686316-488a-4e9d-aa2a-93a02df4218d", "content-length": "4", "date": "Thu, 16 Jan 2025 23:36:40 GMT"} })
66762025-01-16T23:36:41.526ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66772025-01-16T23:36:41.526ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
66782025-01-16T23:36:41.532ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66792025-01-16T23:36:41.532ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
66802025-01-16T23:36:41.538ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = ReleaseVirtualProvisioning
66812025-01-16T23:36:41.538ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = ReleaseVirtualProvisioning
66822025-01-16T23:36:41.562ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-01-16T23:36:41.543561Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 14cc1e33-d5c6-4b7a-bf68-a00ccde56a21, time_modified: Some(2025-01-16T23:36:41.543561Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 53828d51-c7a3-4557-b913-6b5f10d267df, time_modified: Some(2025-01-16T23:36:41.543561Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
66832025-01-16T23:36:41.562ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66842025-01-16T23:36:41.562ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
66852025-01-16T23:36:41.568ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66862025-01-16T23:36:41.568ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
66872025-01-16T23:36:41.571ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
66882025-01-16T23:36:41.571ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = UnassignOximeterProducer
66892025-01-16T23:36:41.571ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = UnassignOximeterProducer
66902025-01-16T23:36:41.581ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 0a365f9e-6c70-4a27-ba2b-6123ad53013e producer_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
66912025-01-16T23:36:41.581ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = UnassignOximeterProducer
66922025-01-16T23:36:41.581ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = UnassignOximeterProducer
66932025-01-16T23:36:41.621ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
66942025-01-16T23:36:41.623ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/7f99f0f0-65b1-4cc7-8391-f8886f9a2d13
66952025-01-16T23:36:41.639ZDEBGnexus (SagaExecutor): client response oximeter-collector = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/7f99f0f0-65b1-4cc7-8391-f8886f9a2d13", status: 204, headers: {"x-request-id": "61c8f780-eb68-4701-81b1-ae340cb3eb20", "date": "Thu, 16 Jan 2025 23:36:41 GMT"} }) saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
66962025-01-16T23:36:41.639ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 0a365f9e-6c70-4a27-ba2b-6123ad53013e producer_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
66972025-01-16T23:36:41.642ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
66982025-01-16T23:36:41.642ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
66992025-01-16T23:36:41.647ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
67002025-01-16T23:36:41.647ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
67012025-01-16T23:36:41.654ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 lock = UpdaterLock { updater_id: e2a46568-cd73-48e3-990a-86a83923f2be, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-01-16T23:36:41.329923561Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
67022025-01-16T23:36:41.654ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = CommitInstanceUpdates
67032025-01-16T23:36:41.655ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = CommitInstanceUpdates
67042025-01-16T23:36:41.677ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 new_runtime = InstanceRuntimeState { time_updated: 2025-01-16T23:36:41.329923561Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
67052025-01-16T23:36:41.677ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
67062025-01-16T23:36:41.677ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
67072025-01-16T23:36:41.677ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
67082025-01-16T23:36:41.677ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
67092025-01-16T23:36:41.677ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
67102025-01-16T23:36:41.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67112025-01-16T23:36:41.677ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67122025-01-16T23:36:41.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67132025-01-16T23:36:41.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67142025-01-16T23:36:41.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67152025-01-16T23:36:41.681ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67162025-01-16T23:36:41.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67172025-01-16T23:36:41.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67182025-01-16T23:36:41.683ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67192025-01-16T23:36:41.683ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
67202025-01-16T23:36:41.683ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
67212025-01-16T23:36:41.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67222025-01-16T23:36:41.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67232025-01-16T23:36:41.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67242025-01-16T23:36:41.688ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
67252025-01-16T23:36:41.688ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("7f99f0f0-65b1-4cc7-8391-f8886f9a2d13"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("2f241142-413f-4577-99ce-e5f36b8bb539")}) node_id = 7 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
67262025-01-16T23:36:41.692ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
67272025-01-16T23:36:41.692ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
67282025-01-16T23:36:41.697ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
67292025-01-16T23:36:41.697ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
67302025-01-16T23:36:41.700ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
67312025-01-16T23:36:41.700ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
67322025-01-16T23:36:41.705ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 propolis_id = 2f241142-413f-4577-99ce-e5f36b8bb539 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
67332025-01-16T23:36:41.705ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = ReleaseSledResources
67342025-01-16T23:36:41.706ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = ReleaseSledResources
67352025-01-16T23:36:41.724ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
67362025-01-16T23:36:41.724ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
67372025-01-16T23:36:41.729ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
67382025-01-16T23:36:41.729ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
67392025-01-16T23:36:41.735ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 propolis_id = 2f241142-413f-4577-99ce-e5f36b8bb539 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
67402025-01-16T23:36:41.735ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = MarkVmmDeleted
67412025-01-16T23:36:41.735ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = MarkVmmDeleted
67422025-01-16T23:36:41.750ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
67432025-01-16T23:36:41.750ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
67442025-01-16T23:36:41.756ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
67452025-01-16T23:36:41.756ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
67462025-01-16T23:36:41.772ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67472025-01-16T23:36:41.772ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67482025-01-16T23:36:41.772ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b952a603-ef30-42f2-9697-57d305f60501", "content-length": "372", "date": "Thu, 16 Jan 2025 23:36:41 GMT"} })
67492025-01-16T23:36:41.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67502025-01-16T23:36:41.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67512025-01-16T23:36:41.774ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67522025-01-16T23:36:41.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67532025-01-16T23:36:41.779ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
67542025-01-16T23:36:41.779ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
67552025-01-16T23:36:41.785ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
67562025-01-16T23:36:41.785ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
67572025-01-16T23:36:41.791ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = ChainSuccessorSaga
67582025-01-16T23:36:41.792ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = ChainSuccessorSaga
67592025-01-16T23:36:41.793ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = ChainSuccessorSaga
67602025-01-16T23:36:41.793ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = ChainSuccessorSaga
67612025-01-16T23:36:41.795ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = ChainSuccessorSaga
67622025-01-16T23:36:41.795ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = ChainSuccessorSaga
67632025-01-16T23:36:41.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67642025-01-16T23:36:41.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67652025-01-16T23:36:41.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67662025-01-16T23:36:41.818ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
67672025-01-16T23:36:41.818ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
67682025-01-16T23:36:41.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67692025-01-16T23:36:41.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67702025-01-16T23:36:41.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67712025-01-16T23:36:41.819ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d0451733-666f-4a84-9b79-6b416cb8d18b", "date": "Thu, 16 Jan 2025 23:36:41 GMT"} })
67722025-01-16T23:36:41.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67732025-01-16T23:36:41.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67742025-01-16T23:36:41.820ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67752025-01-16T23:36:41.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67762025-01-16T23:36:41.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67772025-01-16T23:36:41.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67782025-01-16T23:36:41.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67792025-01-16T23:36:41.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67802025-01-16T23:36:41.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67812025-01-16T23:36:41.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67822025-01-16T23:36:41.828ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
67832025-01-16T23:36:41.828ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67842025-01-16T23:36:41.828ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = ChainSuccessorSaga
67852025-01-16T23:36:41.828ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1b79e4fa-f726-495f-bd1d-c4830bcfb42f", "date": "Thu, 16 Jan 2025 23:36:41 GMT"} })
67862025-01-16T23:36:41.829ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 152.246433ms iteration = 26 status = {}
67872025-01-16T23:36:41.832ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 53828d51-c7a3-4557-b913-6b5f10d267df, lookup_type: ById(53828d51-c7a3-4557-b913-6b5f10d267df) }, key: 14cc1e33-d5c6-4b7a-bf68-a00ccde56a21, lookup_type: ById(14cc1e33-d5c6-4b7a-bf68-a00ccde56a21) }, key: 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13, lookup_type: ById(7f99f0f0-65b1-4cc7-8391-f8886f9a2d13) } result = Ok(()) saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = ChainSuccessorSaga
67882025-01-16T23:36:41.832ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = ChainSuccessorSaga
67892025-01-16T23:36:41.833ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_node = ChainSuccessorSaga
67902025-01-16T23:36:41.838ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 karmic_state = WillReincarnate needs_reincarnation = false saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update
67912025-01-16T23:36:41.838ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
67922025-01-16T23:36:41.838ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
67932025-01-16T23:36:41.844ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
67942025-01-16T23:36:41.844ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
67952025-01-16T23:36:41.850ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
67962025-01-16T23:36:41.850ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
67972025-01-16T23:36:41.858ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67982025-01-16T23:36:41.859ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d86569d0-e547-43c6-8d61-cea0371d63ca", "content-length": "691", "date": "Thu, 16 Jan 2025 23:36:41 GMT"} })
67992025-01-16T23:36:41.859ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
68002025-01-16T23:36:41.859ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
68012025-01-16T23:36:41.859ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
68022025-01-16T23:36:41.861ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 183.314889ms iteration = 26 status = {}
68032025-01-16T23:36:41.864ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
68042025-01-16T23:36:41.864ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d
68052025-01-16T23:36:41.930ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
68062025-01-16T23:36:41.930ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d saga_name = instance-update saga_result = SagaResult { saga_id: fe482d59-1d21-4ffb-9a20-28a9b39a9b6d, saga_log: SagaLog { saga_id: fe482d59-1d21-4ffb-9a20-28a9b39a9b6d, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("e2a46568-cd73-48e3-990a-86a83923f2be")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("e2a46568-cd73-48e3-990a-86a83923f2be")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("7f99f0f0-65b1-4cc7-8391-f8886f9a2d13"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("2f241142-413f-4577-99ce-e5f36b8bb539")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("7f99f0f0-65b1-4cc7-8391-f8886f9a2d13"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("2f241142-413f-4577-99ce-e5f36b8bb539")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("e2a46568-cd73-48e3-990a-86a83923f2be"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("e2a46568-cd73-48e3-990a-86a83923f2be")}} }) }
68072025-01-16T23:36:41.930ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = fe482d59-1d21-4ffb-9a20-28a9b39a9b6d instance_id = 7f99f0f0-65b1-4cc7-8391-f8886f9a2d13 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update
68082025-01-16T23:36:41.930ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
68092025-01-16T23:36:41.930ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33
68102025-01-16T23:36:41.933ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
68112025-01-16T23:36:41.933ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33
68122025-01-16T23:36:41.937ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
68132025-01-16T23:36:41.937ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33
68142025-01-16T23:36:41.940ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
68152025-01-16T23:36:41.940ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33
68162025-01-16T23:36:41.975ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update sec_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
68172025-01-16T23:36:41.975ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 414c87a2-65c3-4c9e-b286-16f644978c33 saga_name = start-instance-update saga_result = SagaResult { saga_id: 414c87a2-65c3-4c9e-b286-16f644978c33, saga_log: SagaLog { saga_id: 414c87a2-65c3-4c9e-b286-16f644978c33, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("003b1657-ed34-4549-aab1-8aad64168822")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("003b1657-ed34-4549-aab1-8aad64168822")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("003b1657-ed34-4549-aab1-8aad64168822"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("003b1657-ed34-4549-aab1-8aad64168822")}} }) }
68182025-01-16T23:36:42.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1bdcb173-5458-40a3-a599-056c3e20de04 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68192025-01-16T23:36:42.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1bdcb173-5458-40a3-a599-056c3e20de04 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68202025-01-16T23:36:42.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1bdcb173-5458-40a3-a599-056c3e20de04 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68212025-01-16T23:36:43.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f627b350-e74d-488d-afe4-52bd5769a8b1 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68222025-01-16T23:36:43.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f627b350-e74d-488d-afe4-52bd5769a8b1 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68232025-01-16T23:36:43.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f627b350-e74d-488d-afe4-52bd5769a8b1 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68242025-01-16T23:36:44.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d6583c84-3855-45e9-a853-decff30a0d8e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68252025-01-16T23:36:44.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d6583c84-3855-45e9-a853-decff30a0d8e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68262025-01-16T23:36:44.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d6583c84-3855-45e9-a853-decff30a0d8e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68272025-01-16T23:36:45.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d16b2939-4f5e-4bbf-9cd4-b16b4bcca566 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68282025-01-16T23:36:45.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d16b2939-4f5e-4bbf-9cd4-b16b4bcca566 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68292025-01-16T23:36:45.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d16b2939-4f5e-4bbf-9cd4-b16b4bcca566 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68302025-01-16T23:36:45.734ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 689 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 166bd44b-20f5-469f-9e62-024e38872baa response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
68312025-01-16T23:36:46.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a321adb6-d2fa-4306-b87c-ee98e1eeb6c9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68322025-01-16T23:36:46.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a321adb6-d2fa-4306-b87c-ee98e1eeb6c9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68332025-01-16T23:36:46.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a321adb6-d2fa-4306-b87c-ee98e1eeb6c9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68342025-01-16T23:36:47.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
68352025-01-16T23:36:47.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68362025-01-16T23:36:47.003ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
68372025-01-16T23:36:47.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68382025-01-16T23:36:47.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68392025-01-16T23:36:47.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68402025-01-16T23:36:47.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68412025-01-16T23:36:47.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68422025-01-16T23:36:47.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68432025-01-16T23:36:47.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68442025-01-16T23:36:47.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68452025-01-16T23:36:47.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68462025-01-16T23:36:47.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68472025-01-16T23:36:47.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
68482025-01-16T23:36:47.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68492025-01-16T23:36:47.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68502025-01-16T23:36:47.025ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
68512025-01-16T23:36:47.025ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.705236ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
68522025-01-16T23:36:47.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68532025-01-16T23:36:47.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68542025-01-16T23:36:47.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.431134ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68552025-01-16T23:36:47.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 484e9183-3ad3-4977-bfcf-06964f8b4493 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68562025-01-16T23:36:47.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 484e9183-3ad3-4977-bfcf-06964f8b4493 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68572025-01-16T23:36:47.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 484e9183-3ad3-4977-bfcf-06964f8b4493 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68582025-01-16T23:36:48.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 72fbcb17-2dec-47ff-96ef-faf7ffc3922a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68592025-01-16T23:36:48.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 72fbcb17-2dec-47ff-96ef-faf7ffc3922a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68602025-01-16T23:36:48.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 72fbcb17-2dec-47ff-96ef-faf7ffc3922a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68612025-01-16T23:36:49.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 47ac8ca6-3666-4782-9396-f074eb2a3641 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68622025-01-16T23:36:49.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 47ac8ca6-3666-4782-9396-f074eb2a3641 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68632025-01-16T23:36:49.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 47ac8ca6-3666-4782-9396-f074eb2a3641 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68642025-01-16T23:36:50.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4a1cddac-504f-4c80-96d0-83c9dfa8b92e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68652025-01-16T23:36:50.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4a1cddac-504f-4c80-96d0-83c9dfa8b92e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68662025-01-16T23:36:50.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4a1cddac-504f-4c80-96d0-83c9dfa8b92e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68672025-01-16T23:36:51.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7894fa77-1641-4b9b-9ea4-96ce9f9a180f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68682025-01-16T23:36:51.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7894fa77-1641-4b9b-9ea4-96ce9f9a180f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68692025-01-16T23:36:51.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7894fa77-1641-4b9b-9ea4-96ce9f9a180f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68702025-01-16T23:36:52.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 594ae988-6dfb-442d-bc52-0df9d2391b3e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68712025-01-16T23:36:52.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 594ae988-6dfb-442d-bc52-0df9d2391b3e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68722025-01-16T23:36:52.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 594ae988-6dfb-442d-bc52-0df9d2391b3e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68732025-01-16T23:36:53.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d636f050-2b77-45be-a988-65923d93e23e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68742025-01-16T23:36:53.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d636f050-2b77-45be-a988-65923d93e23e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68752025-01-16T23:36:53.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2717 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d636f050-2b77-45be-a988-65923d93e23e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68762025-01-16T23:36:54.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bec078c3-91f3-4576-bbe5-c4896a90e4b4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68772025-01-16T23:36:54.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bec078c3-91f3-4576-bbe5-c4896a90e4b4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68782025-01-16T23:36:54.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bec078c3-91f3-4576-bbe5-c4896a90e4b4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68792025-01-16T23:36:55.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 00c47190-39fa-4e76-bc44-15ddcf5e4048 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68802025-01-16T23:36:55.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 00c47190-39fa-4e76-bc44-15ddcf5e4048 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68812025-01-16T23:36:55.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 00c47190-39fa-4e76-bc44-15ddcf5e4048 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68822025-01-16T23:36:55.733ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 625 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 8f74d157-f3a8-43c7-97da-4ab28944fad5 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
68832025-01-16T23:36:56.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9dd53f05-18ea-4b8c-9387-e0242d86f460 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68842025-01-16T23:36:56.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9dd53f05-18ea-4b8c-9387-e0242d86f460 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68852025-01-16T23:36:56.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9dd53f05-18ea-4b8c-9387-e0242d86f460 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
68862025-01-16T23:36:57.002ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
68872025-01-16T23:36:57.002ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
68882025-01-16T23:36:57.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68892025-01-16T23:36:57.002ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68902025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
68912025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
68922025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68932025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
68942025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68952025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68962025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
68972025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68982025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
68992025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
69002025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69012025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
69022025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
69032025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
69042025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
69052025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69062025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69072025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
69082025-01-16T23:36:57.003ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69092025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69102025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
69112025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
69122025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69132025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
69142025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69152025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
69162025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69172025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69182025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
69192025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69202025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69212025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69222025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69232025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69242025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69252025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69262025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69272025-01-16T23:36:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69282025-01-16T23:36:57.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
69292025-01-16T23:36:57.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
69302025-01-16T23:36:57.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
69312025-01-16T23:36:57.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69322025-01-16T23:36:57.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69332025-01-16T23:36:57.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69342025-01-16T23:36:57.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
69352025-01-16T23:36:57.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
69362025-01-16T23:36:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69372025-01-16T23:36:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69382025-01-16T23:36:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69392025-01-16T23:36:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69402025-01-16T23:36:57.005ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69412025-01-16T23:36:57.005ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69422025-01-16T23:36:57.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69432025-01-16T23:36:57.007ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.966996ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
69442025-01-16T23:36:57.007ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1725, tv_nsec: 321624841 } })
69452025-01-16T23:36:57.007ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
69462025-01-16T23:36:57.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69472025-01-16T23:36:57.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
69482025-01-16T23:36:57.008ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
69492025-01-16T23:36:57.008ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69502025-01-16T23:36:57.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
69512025-01-16T23:36:57.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69522025-01-16T23:36:57.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69532025-01-16T23:36:57.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69542025-01-16T23:36:57.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69552025-01-16T23:36:57.011ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1725, tv_nsec: 324926535 } })
69562025-01-16T23:36:57.011ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
69572025-01-16T23:36:57.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69582025-01-16T23:36:57.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69592025-01-16T23:36:57.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
69602025-01-16T23:36:57.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69612025-01-16T23:36:57.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69622025-01-16T23:36:57.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
69632025-01-16T23:36:57.015ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69642025-01-16T23:36:57.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69652025-01-16T23:36:57.019ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69662025-01-16T23:36:57.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69672025-01-16T23:36:57.022ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1725, tv_nsec: 336270212 } })
69682025-01-16T23:36:57.022ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
69692025-01-16T23:36:57.024ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69702025-01-16T23:36:57.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69712025-01-16T23:36:57.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69722025-01-16T23:36:57.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69732025-01-16T23:36:57.054ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69742025-01-16T23:36:57.054ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
69752025-01-16T23:36:57.054ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69762025-01-16T23:36:57.054ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69772025-01-16T23:36:57.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69782025-01-16T23:36:57.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69792025-01-16T23:36:57.055ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69802025-01-16T23:36:57.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69812025-01-16T23:36:57.056ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69822025-01-16T23:36:57.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69832025-01-16T23:36:57.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69842025-01-16T23:36:57.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69852025-01-16T23:36:57.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69862025-01-16T23:36:57.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69872025-01-16T23:36:57.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69882025-01-16T23:36:57.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69892025-01-16T23:36:57.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69902025-01-16T23:36:57.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
69912025-01-16T23:36:57.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69922025-01-16T23:36:57.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69932025-01-16T23:36:57.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69942025-01-16T23:36:57.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69952025-01-16T23:36:57.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69962025-01-16T23:36:57.062ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 59.674757ms iteration = 26 status = 0
69972025-01-16T23:36:57.063ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.990403ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
69982025-01-16T23:36:57.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
69992025-01-16T23:36:57.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70002025-01-16T23:36:57.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70012025-01-16T23:36:57.067ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.878398ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
70022025-01-16T23:36:57.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70032025-01-16T23:36:57.071ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70042025-01-16T23:36:57.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70052025-01-16T23:36:57.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70062025-01-16T23:36:57.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70072025-01-16T23:36:57.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70082025-01-16T23:36:57.072ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70092025-01-16T23:36:57.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70102025-01-16T23:36:57.074ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70112025-01-16T23:36:57.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70122025-01-16T23:36:57.075ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70132025-01-16T23:36:57.076ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70142025-01-16T23:36:57.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70152025-01-16T23:36:57.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
70162025-01-16T23:36:57.078ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70172025-01-16T23:36:57.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70182025-01-16T23:36:57.079ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
70192025-01-16T23:36:57.079ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.121292ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
70202025-01-16T23:36:57.080ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
70212025-01-16T23:36:57.080ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.825515ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
70222025-01-16T23:36:57.090ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70232025-01-16T23:36:57.090ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70242025-01-16T23:36:57.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70252025-01-16T23:36:57.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70262025-01-16T23:36:57.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70272025-01-16T23:36:57.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70282025-01-16T23:36:57.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70292025-01-16T23:36:57.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70302025-01-16T23:36:57.100ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 97.241207ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70312025-01-16T23:36:57.104ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
70322025-01-16T23:36:57.104ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70332025-01-16T23:36:57.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 101.548671ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70342025-01-16T23:36:57.104ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8745893-deaa-46e3-ba27-ce4c685e197e", "content-length": "26", "date": "Thu, 16 Jan 2025 23:36:56 GMT"} })
70352025-01-16T23:36:57.104ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70362025-01-16T23:36:57.106ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70372025-01-16T23:36:57.106ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
70382025-01-16T23:36:57.106ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70392025-01-16T23:36:57.106ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4aca8cc9-53b5-4def-8999-78f7737e5d03", "content-length": "26", "date": "Thu, 16 Jan 2025 23:36:56 GMT"} })
70402025-01-16T23:36:57.106ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70412025-01-16T23:36:57.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.971917ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70422025-01-16T23:36:57.108ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70432025-01-16T23:36:57.109ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
70442025-01-16T23:36:57.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70452025-01-16T23:36:57.109ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 106.111338ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
70462025-01-16T23:36:57.109ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70472025-01-16T23:36:57.121ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
70482025-01-16T23:36:57.121ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70492025-01-16T23:36:57.122ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0acd0366-0380-46ae-9446-da09a898ecd0", "content-length": "26", "date": "Thu, 16 Jan 2025 23:36:56 GMT"} })
70502025-01-16T23:36:57.122ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70512025-01-16T23:36:57.122ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70522025-01-16T23:36:57.122ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
70532025-01-16T23:36:57.122ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.26534ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
70542025-01-16T23:36:57.124ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
70552025-01-16T23:36:57.125ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70562025-01-16T23:36:57.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70572025-01-16T23:36:57.141ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 137.4512ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
70582025-01-16T23:36:57.181ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 178.001169ms iteration = 29 status = {"physical_disks_added":0}
70592025-01-16T23:36:57.193ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70602025-01-16T23:36:57.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70612025-01-16T23:36:57.280ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
70622025-01-16T23:36:57.280ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70632025-01-16T23:36:57.280ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1c3e203-36bf-4246-bde9-fb9a6b05004d", "content-length": "372", "date": "Thu, 16 Jan 2025 23:36:57 GMT"} })
70642025-01-16T23:36:57.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70652025-01-16T23:36:57.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70662025-01-16T23:36:57.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70672025-01-16T23:36:57.311ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70682025-01-16T23:36:57.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70692025-01-16T23:36:57.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70702025-01-16T23:36:57.313ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70712025-01-16T23:36:57.315ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70722025-01-16T23:36:57.315ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70732025-01-16T23:36:57.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70742025-01-16T23:36:57.321ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
70752025-01-16T23:36:57.321ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
70762025-01-16T23:36:57.321ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f3f5ca66-7c2f-4501-aedd-88f2125bd588", "date": "Thu, 16 Jan 2025 23:36:57 GMT"} })
70772025-01-16T23:36:57.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70782025-01-16T23:36:57.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70792025-01-16T23:36:57.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70802025-01-16T23:36:57.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70812025-01-16T23:36:57.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70822025-01-16T23:36:57.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70832025-01-16T23:36:57.330ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
70842025-01-16T23:36:57.330ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70852025-01-16T23:36:57.330ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "78cc7df5-f814-4a08-a6f9-71ba7a279627", "date": "Thu, 16 Jan 2025 23:36:57 GMT"} })
70862025-01-16T23:36:57.332ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 329.024199ms iteration = 27 status = {}
70872025-01-16T23:36:57.426ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 423.227499ms iteration = 26 status = {}
70882025-01-16T23:36:57.429ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
70892025-01-16T23:36:57.429ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fd27136-8a99-4a6e-8d64-b6710ed01d7e", "content-length": "691", "date": "Thu, 16 Jan 2025 23:36:57 GMT"} })
70902025-01-16T23:36:57.429ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
70912025-01-16T23:36:57.429ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
70922025-01-16T23:36:57.429ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
70932025-01-16T23:36:57.431ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 428.740435ms iteration = 27 status = {}
70942025-01-16T23:36:57.438ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
70952025-01-16T23:36:57.438ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1981f313-16e7-4c42-8111-b50f84539782", "content-length": "2", "date": "Thu, 16 Jan 2025 23:36:57 GMT"} })
70962025-01-16T23:36:57.439ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70972025-01-16T23:36:57.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70982025-01-16T23:36:57.441ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 438.719426ms iteration = 26 status = null
70992025-01-16T23:36:57.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71002025-01-16T23:36:57.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71012025-01-16T23:36:57.498ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
71022025-01-16T23:36:57.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71032025-01-16T23:36:57.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71042025-01-16T23:36:57.507ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
71052025-01-16T23:36:57.507ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "093d79de-8daf-4dbf-b3a6-8c123befa829", "content-length": "134", "date": "Thu, 16 Jan 2025 23:36:57 GMT"} })
71062025-01-16T23:36:57.507ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
71072025-01-16T23:36:57.507ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
71082025-01-16T23:36:57.508ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
71092025-01-16T23:36:57.508ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
71102025-01-16T23:36:57.508ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71112025-01-16T23:36:57.508ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71122025-01-16T23:36:57.508ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71132025-01-16T23:36:57.508ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71142025-01-16T23:36:57.508ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71152025-01-16T23:36:57.508ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71162025-01-16T23:36:57.508ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
71172025-01-16T23:36:57.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71182025-01-16T23:36:57.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71192025-01-16T23:36:57.510ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
71202025-01-16T23:36:57.510ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0eaa39e3-d116-48b3-9798-b1e0aa92f77d", "content-length": "2", "date": "Thu, 16 Jan 2025 23:36:57 GMT"} })
71212025-01-16T23:36:57.510ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
71222025-01-16T23:36:57.511ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "acb74ac7-771a-4a2f-8fe5-b5359d42edc8", "content-length": "52", "date": "Thu, 16 Jan 2025 23:36:56 GMT"} })
71232025-01-16T23:36:57.511ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
71242025-01-16T23:36:57.511ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
71252025-01-16T23:36:57.599ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "91d3931c-8fca-4149-bd5b-f2e042ea0332", "date": "Thu, 16 Jan 2025 23:36:57 GMT"} })
71262025-01-16T23:36:57.599ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
71272025-01-16T23:36:57.599ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
71282025-01-16T23:36:57.600ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "79d2763a-b732-47ca-9ee0-34bf4893456a", "content-length": "682", "date": "Thu, 16 Jan 2025 23:36:57 GMT"} })
71292025-01-16T23:36:57.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71302025-01-16T23:36:57.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71312025-01-16T23:36:57.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71322025-01-16T23:36:57.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71332025-01-16T23:36:57.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71342025-01-16T23:36:57.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71352025-01-16T23:36:57.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71362025-01-16T23:36:57.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71372025-01-16T23:36:57.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c7144351-55bf-4f13-ab35-dbe565285b53 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71382025-01-16T23:36:57.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c7144351-55bf-4f13-ab35-dbe565285b53 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71392025-01-16T23:36:57.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c7144351-55bf-4f13-ab35-dbe565285b53 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71402025-01-16T23:36:57.616ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 613.242068ms iteration = 26 status = {}
71412025-01-16T23:36:58.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 066e8ec2-7a29-45c6-b825-318ce553dc71 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71422025-01-16T23:36:58.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 066e8ec2-7a29-45c6-b825-318ce553dc71 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71432025-01-16T23:36:58.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 066e8ec2-7a29-45c6-b825-318ce553dc71 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71442025-01-16T23:36:59.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1712cde1-da1d-43ed-82a4-a821ade8cb77 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71452025-01-16T23:36:59.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1712cde1-da1d-43ed-82a4-a821ade8cb77 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71462025-01-16T23:36:59.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1712cde1-da1d-43ed-82a4-a821ade8cb77 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71472025-01-16T23:37:00.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 764d761f-3ef5-47bd-8694-789fca2950c3 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71482025-01-16T23:37:00.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 764d761f-3ef5-47bd-8694-789fca2950c3 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71492025-01-16T23:37:00.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 764d761f-3ef5-47bd-8694-789fca2950c3 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71502025-01-16T23:37:01.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9bc35206-d722-494b-a408-ecb7fb4c1a68 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71512025-01-16T23:37:01.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9bc35206-d722-494b-a408-ecb7fb4c1a68 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71522025-01-16T23:37:01.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9bc35206-d722-494b-a408-ecb7fb4c1a68 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71532025-01-16T23:37:02.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a3b87f92-2b93-4a9f-afdf-a1d6970e80ae roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71542025-01-16T23:37:02.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a3b87f92-2b93-4a9f-afdf-a1d6970e80ae resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71552025-01-16T23:37:02.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a3b87f92-2b93-4a9f-afdf-a1d6970e80ae response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71562025-01-16T23:37:03.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f31ea00a-eb2a-491e-9dc3-95c12adf4346 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71572025-01-16T23:37:03.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f31ea00a-eb2a-491e-9dc3-95c12adf4346 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71582025-01-16T23:37:03.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f31ea00a-eb2a-491e-9dc3-95c12adf4346 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71592025-01-16T23:37:04.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c9491eb7-75cb-44d2-95e3-faec75e4b530 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71602025-01-16T23:37:04.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c9491eb7-75cb-44d2-95e3-faec75e4b530 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71612025-01-16T23:37:04.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c9491eb7-75cb-44d2-95e3-faec75e4b530 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71622025-01-16T23:37:05.734ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 630 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 66b68aa4-7a71-42f7-a5a1-70bdf4382062 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
71632025-01-16T23:37:05.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 92b4907a-e1d4-484e-a57c-619bcd75e2f3 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71642025-01-16T23:37:05.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 92b4907a-e1d4-484e-a57c-619bcd75e2f3 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71652025-01-16T23:37:05.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 92b4907a-e1d4-484e-a57c-619bcd75e2f3 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71662025-01-16T23:37:06.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 31755645-af96-4c43-8f61-c61275acef35 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71672025-01-16T23:37:06.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 31755645-af96-4c43-8f61-c61275acef35 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71682025-01-16T23:37:06.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 31755645-af96-4c43-8f61-c61275acef35 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71692025-01-16T23:37:07.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
71702025-01-16T23:37:07.003ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
71712025-01-16T23:37:07.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71722025-01-16T23:37:07.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71732025-01-16T23:37:07.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71742025-01-16T23:37:07.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71752025-01-16T23:37:07.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71762025-01-16T23:37:07.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71772025-01-16T23:37:07.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.448825ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71782025-01-16T23:37:07.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71792025-01-16T23:37:07.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71802025-01-16T23:37:07.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71812025-01-16T23:37:07.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71822025-01-16T23:37:07.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71832025-01-16T23:37:07.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71842025-01-16T23:37:07.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71852025-01-16T23:37:07.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
71862025-01-16T23:37:07.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71872025-01-16T23:37:07.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71882025-01-16T23:37:07.058ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
71892025-01-16T23:37:07.058ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.160829ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
71902025-01-16T23:37:07.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5d597e73-c5f5-48f6-b233-c032474e4af4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71912025-01-16T23:37:07.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5d597e73-c5f5-48f6-b233-c032474e4af4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71922025-01-16T23:37:07.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5d597e73-c5f5-48f6-b233-c032474e4af4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71932025-01-16T23:37:08.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b1da2fa4-df61-4020-8876-ba4d2a491412 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71942025-01-16T23:37:08.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b1da2fa4-df61-4020-8876-ba4d2a491412 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71952025-01-16T23:37:08.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b1da2fa4-df61-4020-8876-ba4d2a491412 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71962025-01-16T23:37:09.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b90c7dcd-4694-4efb-b7fa-21ca3c72d9ee roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71972025-01-16T23:37:09.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b90c7dcd-4694-4efb-b7fa-21ca3c72d9ee resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71982025-01-16T23:37:09.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b90c7dcd-4694-4efb-b7fa-21ca3c72d9ee response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
71992025-01-16T23:37:10.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = feeee17a-54c1-4619-8a8c-003b9a3ce3fb roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72002025-01-16T23:37:10.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = feeee17a-54c1-4619-8a8c-003b9a3ce3fb resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72012025-01-16T23:37:10.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = feeee17a-54c1-4619-8a8c-003b9a3ce3fb response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72022025-01-16T23:37:11.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c937c500-2f48-42db-b118-b9191e502c09 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72032025-01-16T23:37:11.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c937c500-2f48-42db-b118-b9191e502c09 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72042025-01-16T23:37:11.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c937c500-2f48-42db-b118-b9191e502c09 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72052025-01-16T23:37:12.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e151c96e-1327-49c7-906c-55b531831fc0 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72062025-01-16T23:37:12.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e151c96e-1327-49c7-906c-55b531831fc0 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72072025-01-16T23:37:12.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e151c96e-1327-49c7-906c-55b531831fc0 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72082025-01-16T23:37:13.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2883a73a-5a93-485a-9acc-6b56b213b651 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72092025-01-16T23:37:13.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2883a73a-5a93-485a-9acc-6b56b213b651 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72102025-01-16T23:37:13.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2883a73a-5a93-485a-9acc-6b56b213b651 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72112025-01-16T23:37:14.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6377074e-e895-4482-851e-138c2a528bae roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72122025-01-16T23:37:14.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6377074e-e895-4482-851e-138c2a528bae resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72132025-01-16T23:37:14.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6377074e-e895-4482-851e-138c2a528bae response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72142025-01-16T23:37:15.734ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 595 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 6a4a7cb0-446f-43b9-8b24-e4e5078bc00d response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
72152025-01-16T23:37:16.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ae33b5b7-352b-4b7e-90aa-3ef17e9b4b50 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72162025-01-16T23:37:16.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ae33b5b7-352b-4b7e-90aa-3ef17e9b4b50 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72172025-01-16T23:37:16.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ae33b5b7-352b-4b7e-90aa-3ef17e9b4b50 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72182025-01-16T23:37:17.002ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
72192025-01-16T23:37:17.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72202025-01-16T23:37:17.002ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
72212025-01-16T23:37:17.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72222025-01-16T23:37:17.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72232025-01-16T23:37:17.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72242025-01-16T23:37:17.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72252025-01-16T23:37:17.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72262025-01-16T23:37:17.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72272025-01-16T23:37:17.006ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.562939ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72282025-01-16T23:37:17.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72292025-01-16T23:37:17.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72302025-01-16T23:37:17.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72312025-01-16T23:37:17.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72322025-01-16T23:37:17.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72332025-01-16T23:37:17.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72342025-01-16T23:37:17.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
72352025-01-16T23:37:17.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72362025-01-16T23:37:17.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72372025-01-16T23:37:17.023ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
72382025-01-16T23:37:17.023ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.224858ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
72392025-01-16T23:37:17.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9b57e3ce-bd7f-4c6b-99a2-bbaa87342560 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72402025-01-16T23:37:17.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9b57e3ce-bd7f-4c6b-99a2-bbaa87342560 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72412025-01-16T23:37:17.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9b57e3ce-bd7f-4c6b-99a2-bbaa87342560 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72422025-01-16T23:37:18.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d5e0e55a-3790-4930-9a21-548d2d043539 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72432025-01-16T23:37:18.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d5e0e55a-3790-4930-9a21-548d2d043539 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72442025-01-16T23:37:18.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d5e0e55a-3790-4930-9a21-548d2d043539 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72452025-01-16T23:37:19.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7e5a73c8-ec73-4871-a54b-f0fada6ce236 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72462025-01-16T23:37:19.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7e5a73c8-ec73-4871-a54b-f0fada6ce236 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72472025-01-16T23:37:19.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7e5a73c8-ec73-4871-a54b-f0fada6ce236 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72482025-01-16T23:37:20.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aa7ba79b-fd8c-41d2-9a34-4cc311bb4830 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72492025-01-16T23:37:20.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aa7ba79b-fd8c-41d2-9a34-4cc311bb4830 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72502025-01-16T23:37:20.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2641 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = aa7ba79b-fd8c-41d2-9a34-4cc311bb4830 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72512025-01-16T23:37:21.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5a8fdb9b-bc35-4c21-9cad-b9f147340df7 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72522025-01-16T23:37:21.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5a8fdb9b-bc35-4c21-9cad-b9f147340df7 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72532025-01-16T23:37:21.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5a8fdb9b-bc35-4c21-9cad-b9f147340df7 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72542025-01-16T23:37:22.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 91eeea34-7afd-4c85-a614-9cab40ca317f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72552025-01-16T23:37:22.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 91eeea34-7afd-4c85-a614-9cab40ca317f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72562025-01-16T23:37:22.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 91eeea34-7afd-4c85-a614-9cab40ca317f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72572025-01-16T23:37:23.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ea9f8c2e-d338-43e2-b052-b241f06babea roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72582025-01-16T23:37:23.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ea9f8c2e-d338-43e2-b052-b241f06babea resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72592025-01-16T23:37:23.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2664 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ea9f8c2e-d338-43e2-b052-b241f06babea response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72602025-01-16T23:37:24.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e73e3397-6b7a-4f70-b5ad-801f6c61acc6 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72612025-01-16T23:37:24.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e73e3397-6b7a-4f70-b5ad-801f6c61acc6 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72622025-01-16T23:37:24.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e73e3397-6b7a-4f70-b5ad-801f6c61acc6 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72632025-01-16T23:37:25.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 66205f0b-7864-4c20-934d-077ece3886d4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72642025-01-16T23:37:25.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 66205f0b-7864-4c20-934d-077ece3886d4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72652025-01-16T23:37:25.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 66205f0b-7864-4c20-934d-077ece3886d4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72662025-01-16T23:37:25.734ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 564 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 32ba0c6a-5c03-4c29-909a-ce2557266296 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
72672025-01-16T23:37:26.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 14a3c71a-5d2f-4881-8fe5-07085290af0e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72682025-01-16T23:37:26.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 14a3c71a-5d2f-4881-8fe5-07085290af0e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72692025-01-16T23:37:26.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 14a3c71a-5d2f-4881-8fe5-07085290af0e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
72702025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
72712025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72722025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
72732025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72742025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
72752025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
72762025-01-16T23:37:27.003ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-16 23:27:27.003202628 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
72772025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
72782025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
72792025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
72802025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72812025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
72822025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
72832025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
72842025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
72852025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72862025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
72872025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72882025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
72892025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
72902025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
72912025-01-16T23:37:27.003ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
72922025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
72932025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
72942025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
72952025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72962025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
72972025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72982025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
72992025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
73002025-01-16T23:37:27.003ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca
73012025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.76\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca"}
73022025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73032025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
73042025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
73052025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
73062025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
73072025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73082025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
73092025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
73102025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
73112025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
73122025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73132025-01-16T23:37:27.003ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
73142025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73152025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
73162025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
73172025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73182025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
73192025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
73202025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73212025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73222025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73232025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
73242025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73252025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73262025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
73272025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
73282025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
73292025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
73302025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73312025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
73322025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
73332025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
73342025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73352025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
73362025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
73372025-01-16T23:37:27.003ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
73382025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73392025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
73402025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
73412025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73422025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
73432025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73442025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73452025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73462025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73472025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73482025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
73492025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73502025-01-16T23:37:27.004ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dc5f3810-93b6-44f1-815c-44411abf99ad.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1755, tv_nsec: 317680445 } })
73512025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73522025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73532025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73542025-01-16T23:37:27.004ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5c1ab32c-50b8-4564-bf29-e388b915cbdb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd10c057-8c9f-4db2-98b5-bcf5e0d536ba.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1755, tv_nsec: 317772177 } })
73552025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
73562025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
73572025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
73582025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73592025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73602025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
73612025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
73622025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.207503ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
73632025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
73642025-01-16T23:37:27.004ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.365836ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
73652025-01-16T23:37:27.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73662025-01-16T23:37:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73672025-01-16T23:37:27.005ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73682025-01-16T23:37:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73692025-01-16T23:37:27.006ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-16 23:27:27.003202628 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
73702025-01-16T23:37:27.006ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.734792ms iteration = 14 status = {"expiration":"2025-01-16T23:27:27.003202628Z","pruned":[]}
73712025-01-16T23:37:27.007ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73722025-01-16T23:37:27.007ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.238961ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
73732025-01-16T23:37:27.008ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73742025-01-16T23:37:27.008ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1755, tv_nsec: 322023669 } })
73752025-01-16T23:37:27.008ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
73762025-01-16T23:37:27.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
73772025-01-16T23:37:27.009ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73782025-01-16T23:37:27.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73792025-01-16T23:37:27.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
73802025-01-16T23:37:27.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73812025-01-16T23:37:27.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73822025-01-16T23:37:27.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73832025-01-16T23:37:27.014ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73842025-01-16T23:37:27.014ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1755, tv_nsec: 328373531 } })
73852025-01-16T23:37:27.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73862025-01-16T23:37:27.015ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
73872025-01-16T23:37:27.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
73882025-01-16T23:37:27.016ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73892025-01-16T23:37:27.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73902025-01-16T23:37:27.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73912025-01-16T23:37:27.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73922025-01-16T23:37:27.017ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73932025-01-16T23:37:27.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73942025-01-16T23:37:27.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73952025-01-16T23:37:27.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73962025-01-16T23:37:27.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73972025-01-16T23:37:27.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73982025-01-16T23:37:27.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73992025-01-16T23:37:27.020ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.834203ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
74002025-01-16T23:37:27.020ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.877394ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
74012025-01-16T23:37:27.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
74022025-01-16T23:37:27.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74032025-01-16T23:37:27.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74042025-01-16T23:37:27.024ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.156356ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74052025-01-16T23:37:27.025ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74062025-01-16T23:37:27.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74072025-01-16T23:37:27.025ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74082025-01-16T23:37:27.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74092025-01-16T23:37:27.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74102025-01-16T23:37:27.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74112025-01-16T23:37:27.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74122025-01-16T23:37:27.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74132025-01-16T23:37:27.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74142025-01-16T23:37:27.028ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1755, tv_nsec: 342454331 } })
74152025-01-16T23:37:27.029ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
74162025-01-16T23:37:27.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
74172025-01-16T23:37:27.030ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74182025-01-16T23:37:27.031ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74192025-01-16T23:37:27.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74202025-01-16T23:37:27.034ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74212025-01-16T23:37:27.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
74222025-01-16T23:37:27.035ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74232025-01-16T23:37:27.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74242025-01-16T23:37:27.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74252025-01-16T23:37:27.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74262025-01-16T23:37:27.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
74272025-01-16T23:37:27.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74282025-01-16T23:37:27.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74292025-01-16T23:37:27.047ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74302025-01-16T23:37:27.047ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
74312025-01-16T23:37:27.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74322025-01-16T23:37:27.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74332025-01-16T23:37:27.050ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74342025-01-16T23:37:27.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74352025-01-16T23:37:27.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
74362025-01-16T23:37:27.052ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
74372025-01-16T23:37:27.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
74382025-01-16T23:37:27.054ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74392025-01-16T23:37:27.054ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74402025-01-16T23:37:27.054ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74412025-01-16T23:37:27.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74422025-01-16T23:37:27.055ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74432025-01-16T23:37:27.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74442025-01-16T23:37:27.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
74452025-01-16T23:37:27.056ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
74462025-01-16T23:37:27.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
74472025-01-16T23:37:27.058ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74482025-01-16T23:37:27.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74492025-01-16T23:37:27.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74502025-01-16T23:37:27.061ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74512025-01-16T23:37:27.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74522025-01-16T23:37:27.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74532025-01-16T23:37:27.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74542025-01-16T23:37:27.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74552025-01-16T23:37:27.063ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.937222ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
74562025-01-16T23:37:27.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74572025-01-16T23:37:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74582025-01-16T23:37:27.068ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
74592025-01-16T23:37:27.068ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
74602025-01-16T23:37:27.068ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 64.712063ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
74612025-01-16T23:37:27.070ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.639439ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
74622025-01-16T23:37:27.073ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74632025-01-16T23:37:27.076ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
74642025-01-16T23:37:27.076ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.032073ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
74652025-01-16T23:37:27.077ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74662025-01-16T23:37:27.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74672025-01-16T23:37:27.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
74682025-01-16T23:37:27.078ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
74692025-01-16T23:37:27.078ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
74702025-01-16T23:37:27.078ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
74712025-01-16T23:37:27.078ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74722025-01-16T23:37:27.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74732025-01-16T23:37:27.079ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74742025-01-16T23:37:27.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74752025-01-16T23:37:27.081ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
74762025-01-16T23:37:27.081ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.869715ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
74772025-01-16T23:37:27.091ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74782025-01-16T23:37:27.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74792025-01-16T23:37:27.098ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74802025-01-16T23:37:27.098ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
74812025-01-16T23:37:27.098ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74822025-01-16T23:37:27.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74832025-01-16T23:37:27.099ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
74842025-01-16T23:37:27.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
74852025-01-16T23:37:27.104ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
74862025-01-16T23:37:27.104ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
74872025-01-16T23:37:27.105ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
74882025-01-16T23:37:27.105ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 101.651323ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
74892025-01-16T23:37:27.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
74902025-01-16T23:37:27.116ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
74912025-01-16T23:37:27.116ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
74922025-01-16T23:37:27.116ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
74932025-01-16T23:37:27.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74942025-01-16T23:37:27.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74952025-01-16T23:37:27.121ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74962025-01-16T23:37:27.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
74972025-01-16T23:37:27.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74982025-01-16T23:37:27.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74992025-01-16T23:37:27.145ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
75002025-01-16T23:37:27.145ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75012025-01-16T23:37:27.145ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "36369948-209a-41c6-a9c0-02592ace6edb", "content-length": "26", "date": "Thu, 16 Jan 2025 23:37:27 GMT"} })
75022025-01-16T23:37:27.145ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75032025-01-16T23:37:27.147ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75042025-01-16T23:37:27.156ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
75052025-01-16T23:37:27.156ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75062025-01-16T23:37:27.157ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb0fec1b-2053-4e99-81d2-6b94c717c7f5", "content-length": "26", "date": "Thu, 16 Jan 2025 23:37:27 GMT"} })
75072025-01-16T23:37:27.157ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75082025-01-16T23:37:27.159ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
75092025-01-16T23:37:27.162ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 158.83302ms iteration = 30 status = {"physical_disks_added":0}
75102025-01-16T23:37:27.167ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
75112025-01-16T23:37:27.167ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
75122025-01-16T23:37:27.179ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
75132025-01-16T23:37:27.179ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75142025-01-16T23:37:27.179ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0128712-26a6-4efd-8129-197cc26d7fb0", "content-length": "26", "date": "Thu, 16 Jan 2025 23:37:27 GMT"} })
75152025-01-16T23:37:27.180ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75162025-01-16T23:37:27.180ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75172025-01-16T23:37:27.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75182025-01-16T23:37:27.181ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75192025-01-16T23:37:27.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6f1e48c9-f310-45d1-a808-2c12d8c22f83 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
75202025-01-16T23:37:27.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6f1e48c9-f310-45d1-a808-2c12d8c22f83 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
75212025-01-16T23:37:27.344ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
75222025-01-16T23:37:27.344ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75232025-01-16T23:37:27.349ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75242025-01-16T23:37:27.350ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 347.043245ms iteration = 27 status = 0
75252025-01-16T23:37:27.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
75262025-01-16T23:37:27.351ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
75272025-01-16T23:37:27.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
75282025-01-16T23:37:27.353ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
75292025-01-16T23:37:27.353ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 350.047633ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
75302025-01-16T23:37:27.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6f1e48c9-f310-45d1-a808-2c12d8c22f83 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
75312025-01-16T23:37:27.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75322025-01-16T23:37:27.387ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 383.874802ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
75332025-01-16T23:37:27.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75342025-01-16T23:37:27.388ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75352025-01-16T23:37:27.388ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
75362025-01-16T23:37:27.388ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 385.534555ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
75372025-01-16T23:37:27.389ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75382025-01-16T23:37:27.390ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75392025-01-16T23:37:27.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75402025-01-16T23:37:27.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75412025-01-16T23:37:27.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75422025-01-16T23:37:27.393ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75432025-01-16T23:37:27.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
75442025-01-16T23:37:27.394ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75452025-01-16T23:37:27.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75462025-01-16T23:37:27.395ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
75472025-01-16T23:37:27.395ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75482025-01-16T23:37:27.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75492025-01-16T23:37:27.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75502025-01-16T23:37:27.399ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75512025-01-16T23:37:27.399ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75522025-01-16T23:37:27.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75532025-01-16T23:37:27.400ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75542025-01-16T23:37:27.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75552025-01-16T23:37:27.402ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75562025-01-16T23:37:27.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75572025-01-16T23:37:27.418ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 414.693984ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
75582025-01-16T23:37:27.419ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
75592025-01-16T23:37:27.419ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 415.839516ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
75602025-01-16T23:37:27.427ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 423.742518ms iteration = 27 status = {}
75612025-01-16T23:37:27.428ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
75622025-01-16T23:37:27.428ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
75632025-01-16T23:37:27.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75642025-01-16T23:37:27.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75652025-01-16T23:37:27.430ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75662025-01-16T23:37:27.431ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
75672025-01-16T23:37:27.431ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 0 version = 2
75682025-01-16T23:37:27.431ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75692025-01-16T23:37:27.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75702025-01-16T23:37:27.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75712025-01-16T23:37:27.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75722025-01-16T23:37:27.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75732025-01-16T23:37:27.436ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
75742025-01-16T23:37:27.436ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
75752025-01-16T23:37:27.436ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-16 23:25:20.756297 UTC dns_group = internal generation = 1
75762025-01-16T23:37:27.436ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 433.075528ms iteration = 14 status = {"generation":1}
75772025-01-16T23:37:27.446ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-16T23:24:20.471931Z, time_modified: 2025-01-16T23:24:20.471931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }) }
75782025-01-16T23:37:27.446ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 443.278183ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]}},"default_endpoint":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
75792025-01-16T23:37:27.453ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab298e5a-7abd-4fe4-9140-1957203b0781", "content-length": "372", "date": "Thu, 16 Jan 2025 23:37:27 GMT"} })
75802025-01-16T23:37:27.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75812025-01-16T23:37:27.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75822025-01-16T23:37:27.461ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
75832025-01-16T23:37:27.461ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5b35bd4-d4c9-45cf-8a99-62b705e258d3", "content-length": "2", "date": "Thu, 16 Jan 2025 23:37:26 GMT"} })
75842025-01-16T23:37:27.462ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75852025-01-16T23:37:27.463ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75862025-01-16T23:37:27.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75872025-01-16T23:37:27.465ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 461.800709ms iteration = 27 status = null
75882025-01-16T23:37:27.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
75892025-01-16T23:37:27.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75902025-01-16T23:37:27.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75912025-01-16T23:37:27.467ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 1 version = 2
75922025-01-16T23:37:27.467ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
75932025-01-16T23:37:27.467ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-16 23:25:21.695734 UTC dns_group = external generation = 2
75942025-01-16T23:37:27.467ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 464.144134ms iteration = 14 status = {"generation":2}
75952025-01-16T23:37:27.486ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
75962025-01-16T23:37:27.496ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
75972025-01-16T23:37:27.496ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
75982025-01-16T23:37:27.497ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a4c0f779-4532-4cb2-97f2-528b0ca4dfa7", "date": "Thu, 16 Jan 2025 23:37:27 GMT"} })
75992025-01-16T23:37:27.497ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76002025-01-16T23:37:27.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76012025-01-16T23:37:27.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76022025-01-16T23:37:27.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76032025-01-16T23:37:27.514ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
76042025-01-16T23:37:27.514ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5d7e2954-4a7c-4452-ab09-1f6e5b7bff62", "date": "Thu, 16 Jan 2025 23:37:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
76052025-01-16T23:37:27.514ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
76062025-01-16T23:37:27.516ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "94b6294a-eef7-40b8-b071-d4e091697c9b", "date": "Thu, 16 Jan 2025 23:37:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
76072025-01-16T23:37:27.516ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
76082025-01-16T23:37:27.518ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
76092025-01-16T23:37:27.518ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 515.607083ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
76102025-01-16T23:37:27.559ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76112025-01-16T23:37:27.559ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "53d2fba7-d704-4d47-9b1e-b78c3d0f6d42", "content-length": "691", "date": "Thu, 16 Jan 2025 23:37:27 GMT"} })
76122025-01-16T23:37:27.559ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
76132025-01-16T23:37:27.559ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
76142025-01-16T23:37:27.559ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
76152025-01-16T23:37:27.560ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 557.412526ms iteration = 28 status = {}
76162025-01-16T23:37:27.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76172025-01-16T23:37:27.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76182025-01-16T23:37:27.564ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
76192025-01-16T23:37:27.564ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76202025-01-16T23:37:27.564ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "60953928-d38b-47f0-99ba-f1ddaae76ab9", "date": "Thu, 16 Jan 2025 23:37:27 GMT"} })
76212025-01-16T23:37:27.566ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 562.607726ms iteration = 28 status = {}
76222025-01-16T23:37:27.573ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
76232025-01-16T23:37:27.573ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a286edda-b4d4-45b2-b007-ec86e8c7ddfc", "date": "Thu, 16 Jan 2025 23:37:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
76242025-01-16T23:37:27.573ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
76252025-01-16T23:37:27.575ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "72a05c4d-81c1-4569-8a1d-689dcf46b046", "date": "Thu, 16 Jan 2025 23:37:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
76262025-01-16T23:37:27.575ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
76272025-01-16T23:37:27.577ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c407003c-80ae-4a74-af84-924f78342dd3", "date": "Thu, 16 Jan 2025 23:37:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
76282025-01-16T23:37:27.577ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
76292025-01-16T23:37:27.579ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
76302025-01-16T23:37:27.579ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 576.250077ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
76312025-01-16T23:37:27.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76322025-01-16T23:37:27.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76332025-01-16T23:37:27.602ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
76342025-01-16T23:37:27.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76352025-01-16T23:37:27.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76362025-01-16T23:37:27.611ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
76372025-01-16T23:37:27.611ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "40c3f91f-7902-49db-9ac4-c5d052c853f7", "content-length": "134", "date": "Thu, 16 Jan 2025 23:37:26 GMT"} })
76382025-01-16T23:37:27.611ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
76392025-01-16T23:37:27.611ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
76402025-01-16T23:37:27.611ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
76412025-01-16T23:37:27.611ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
76422025-01-16T23:37:27.611ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76432025-01-16T23:37:27.611ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76442025-01-16T23:37:27.611ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76452025-01-16T23:37:27.611ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76462025-01-16T23:37:27.611ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76472025-01-16T23:37:27.611ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76482025-01-16T23:37:27.612ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
76492025-01-16T23:37:27.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76502025-01-16T23:37:27.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76512025-01-16T23:37:27.614ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
76522025-01-16T23:37:27.614ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b19a2c8-f989-4862-8504-5aec69c3b150", "content-length": "2", "date": "Thu, 16 Jan 2025 23:37:26 GMT"} })
76532025-01-16T23:37:27.614ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
76542025-01-16T23:37:27.614ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f6e9928-e9d0-432b-acba-46db172e8310", "content-length": "52", "date": "Thu, 16 Jan 2025 23:37:27 GMT"} })
76552025-01-16T23:37:27.614ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
76562025-01-16T23:37:27.614ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
76572025-01-16T23:37:27.708ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "049e92fc-e796-4821-b2cd-d114f100fd7f", "date": "Thu, 16 Jan 2025 23:37:27 GMT"} })
76582025-01-16T23:37:27.708ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
76592025-01-16T23:37:27.708ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
76602025-01-16T23:37:27.709ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3072a2d4-3c79-483f-a20e-505ed7bf4e4a", "content-length": "682", "date": "Thu, 16 Jan 2025 23:37:27 GMT"} })
76612025-01-16T23:37:27.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76622025-01-16T23:37:27.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76632025-01-16T23:37:27.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76642025-01-16T23:37:27.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76652025-01-16T23:37:27.716ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76662025-01-16T23:37:27.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76672025-01-16T23:37:27.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76682025-01-16T23:37:27.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76692025-01-16T23:37:27.726ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 723.117297ms iteration = 27 status = {}
76702025-01-16T23:37:28.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 212486c6-5800-454b-890a-bf9f51a28766 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76712025-01-16T23:37:28.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 212486c6-5800-454b-890a-bf9f51a28766 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76722025-01-16T23:37:28.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 212486c6-5800-454b-890a-bf9f51a28766 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76732025-01-16T23:37:29.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a70bfa7c-91a7-42f1-93e2-29478e379ef2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76742025-01-16T23:37:29.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a70bfa7c-91a7-42f1-93e2-29478e379ef2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76752025-01-16T23:37:29.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a70bfa7c-91a7-42f1-93e2-29478e379ef2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76762025-01-16T23:37:30.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bb6ea2ce-9bfa-41ac-8a15-5cee09f42734 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76772025-01-16T23:37:30.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bb6ea2ce-9bfa-41ac-8a15-5cee09f42734 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76782025-01-16T23:37:30.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2636 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bb6ea2ce-9bfa-41ac-8a15-5cee09f42734 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76792025-01-16T23:37:31.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0ad92124-f140-4f7f-8eb9-88cb8d4b8dd3 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76802025-01-16T23:37:31.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0ad92124-f140-4f7f-8eb9-88cb8d4b8dd3 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76812025-01-16T23:37:31.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0ad92124-f140-4f7f-8eb9-88cb8d4b8dd3 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76822025-01-16T23:37:32.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d07f08e2-e3aa-405d-a95e-7098173efc49 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76832025-01-16T23:37:32.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d07f08e2-e3aa-405d-a95e-7098173efc49 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76842025-01-16T23:37:32.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d07f08e2-e3aa-405d-a95e-7098173efc49 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76852025-01-16T23:37:33.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b144a5fb-4d10-49a6-8813-2f6c795a0595 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76862025-01-16T23:37:33.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b144a5fb-4d10-49a6-8813-2f6c795a0595 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76872025-01-16T23:37:33.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b144a5fb-4d10-49a6-8813-2f6c795a0595 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76882025-01-16T23:37:34.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = da96529a-af75-4d6e-99f0-d1aa04ab77d9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76892025-01-16T23:37:34.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = da96529a-af75-4d6e-99f0-d1aa04ab77d9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76902025-01-16T23:37:34.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = da96529a-af75-4d6e-99f0-d1aa04ab77d9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76912025-01-16T23:37:35.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a169172b-d068-42c4-a17d-33c9d7282f45 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76922025-01-16T23:37:35.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a169172b-d068-42c4-a17d-33c9d7282f45 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76932025-01-16T23:37:35.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a169172b-d068-42c4-a17d-33c9d7282f45 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76942025-01-16T23:37:35.734ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 658 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 748ff5da-befc-4fb7-a83b-73ded210de81 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
76952025-01-16T23:37:36.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ea17f392-c923-481e-8081-94b21b4c46d7 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76962025-01-16T23:37:36.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ea17f392-c923-481e-8081-94b21b4c46d7 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76972025-01-16T23:37:36.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ea17f392-c923-481e-8081-94b21b4c46d7 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
76982025-01-16T23:37:37.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
76992025-01-16T23:37:37.003ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
77002025-01-16T23:37:37.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77012025-01-16T23:37:37.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77022025-01-16T23:37:37.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77032025-01-16T23:37:37.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77042025-01-16T23:37:37.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77052025-01-16T23:37:37.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77062025-01-16T23:37:37.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77072025-01-16T23:37:37.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77082025-01-16T23:37:37.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77092025-01-16T23:37:37.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77102025-01-16T23:37:37.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77112025-01-16T23:37:37.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77122025-01-16T23:37:37.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77132025-01-16T23:37:37.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
77142025-01-16T23:37:37.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77152025-01-16T23:37:37.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77162025-01-16T23:37:37.051ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
77172025-01-16T23:37:37.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.572193ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
77182025-01-16T23:37:37.061ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.254429ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77192025-01-16T23:37:37.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8307b67c-d6d6-4f3c-a075-eb9a304a16f2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77202025-01-16T23:37:37.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8307b67c-d6d6-4f3c-a075-eb9a304a16f2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77212025-01-16T23:37:37.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8307b67c-d6d6-4f3c-a075-eb9a304a16f2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77222025-01-16T23:37:38.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b212b998-ec26-4310-bf3f-51bfc92cffaf roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77232025-01-16T23:37:38.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b212b998-ec26-4310-bf3f-51bfc92cffaf resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77242025-01-16T23:37:38.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b212b998-ec26-4310-bf3f-51bfc92cffaf response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77252025-01-16T23:37:39.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 857e8e0d-7090-479d-83d3-7addd2a02b5c roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77262025-01-16T23:37:39.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 857e8e0d-7090-479d-83d3-7addd2a02b5c resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77272025-01-16T23:37:39.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 857e8e0d-7090-479d-83d3-7addd2a02b5c response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77282025-01-16T23:37:40.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d797d3bf-f136-4502-97f6-499f1005746b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77292025-01-16T23:37:40.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d797d3bf-f136-4502-97f6-499f1005746b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77302025-01-16T23:37:40.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d797d3bf-f136-4502-97f6-499f1005746b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77312025-01-16T23:37:41.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7c2e8ab1-2b02-4aa3-9eed-188e65b2f5b6 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77322025-01-16T23:37:41.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7c2e8ab1-2b02-4aa3-9eed-188e65b2f5b6 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77332025-01-16T23:37:41.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2751 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7c2e8ab1-2b02-4aa3-9eed-188e65b2f5b6 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77342025-01-16T23:37:42.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3bea975f-7d77-472f-ad48-dbc2e265489a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77352025-01-16T23:37:42.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3bea975f-7d77-472f-ad48-dbc2e265489a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77362025-01-16T23:37:42.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3bea975f-7d77-472f-ad48-dbc2e265489a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77372025-01-16T23:37:43.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b762cf58-eb34-4e33-8903-85c1c80a27ff roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77382025-01-16T23:37:43.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b762cf58-eb34-4e33-8903-85c1c80a27ff resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77392025-01-16T23:37:43.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = b762cf58-eb34-4e33-8903-85c1c80a27ff response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77402025-01-16T23:37:44.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f8f725e2-ffc2-4911-a7a9-93f945350773 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77412025-01-16T23:37:44.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f8f725e2-ffc2-4911-a7a9-93f945350773 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77422025-01-16T23:37:44.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f8f725e2-ffc2-4911-a7a9-93f945350773 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77432025-01-16T23:37:45.734ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 646 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = e8cd23fb-da56-4e46-887c-0aed4bd16219 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
77442025-01-16T23:37:45.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 12163d72-8209-47df-9b8c-a6fc394d687e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77452025-01-16T23:37:45.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 12163d72-8209-47df-9b8c-a6fc394d687e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77462025-01-16T23:37:45.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 12163d72-8209-47df-9b8c-a6fc394d687e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77472025-01-16T23:37:46.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 45d5ac35-efe1-41c1-9062-6bf4b276da6f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77482025-01-16T23:37:46.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 45d5ac35-efe1-41c1-9062-6bf4b276da6f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77492025-01-16T23:37:46.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 45d5ac35-efe1-41c1-9062-6bf4b276da6f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77502025-01-16T23:37:47.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
77512025-01-16T23:37:47.003ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
77522025-01-16T23:37:47.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77532025-01-16T23:37:47.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77542025-01-16T23:37:47.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77552025-01-16T23:37:47.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77562025-01-16T23:37:47.005ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77572025-01-16T23:37:47.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77582025-01-16T23:37:47.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77592025-01-16T23:37:47.033ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.368553ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77602025-01-16T23:37:47.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77612025-01-16T23:37:47.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77622025-01-16T23:37:47.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77632025-01-16T23:37:47.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77642025-01-16T23:37:47.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77652025-01-16T23:37:47.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77662025-01-16T23:37:47.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
77672025-01-16T23:37:47.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77682025-01-16T23:37:47.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77692025-01-16T23:37:47.054ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
77702025-01-16T23:37:47.054ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.56887ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
77712025-01-16T23:37:47.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e361618c-30bc-416e-a718-123fe2bf481a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77722025-01-16T23:37:47.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e361618c-30bc-416e-a718-123fe2bf481a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77732025-01-16T23:37:47.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e361618c-30bc-416e-a718-123fe2bf481a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77742025-01-16T23:37:48.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = eae32e4b-7edc-439c-a84e-df796e65ca18 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77752025-01-16T23:37:48.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = eae32e4b-7edc-439c-a84e-df796e65ca18 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77762025-01-16T23:37:48.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = eae32e4b-7edc-439c-a84e-df796e65ca18 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77772025-01-16T23:37:49.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 288353f1-2913-4b04-95b1-9702361b125e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77782025-01-16T23:37:49.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 288353f1-2913-4b04-95b1-9702361b125e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77792025-01-16T23:37:49.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 288353f1-2913-4b04-95b1-9702361b125e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77802025-01-16T23:37:50.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6869e7af-013a-4b1d-9551-da8f3e850fd1 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77812025-01-16T23:37:50.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6869e7af-013a-4b1d-9551-da8f3e850fd1 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77822025-01-16T23:37:50.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6869e7af-013a-4b1d-9551-da8f3e850fd1 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77832025-01-16T23:37:51.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f7092409-e48b-4616-b5f8-05fa108b15c3 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77842025-01-16T23:37:51.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f7092409-e48b-4616-b5f8-05fa108b15c3 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77852025-01-16T23:37:51.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f7092409-e48b-4616-b5f8-05fa108b15c3 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77862025-01-16T23:37:53.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8db27198-f5bd-40b9-ade9-31352a85f2fd roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77872025-01-16T23:37:53.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8db27198-f5bd-40b9-ade9-31352a85f2fd resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77882025-01-16T23:37:53.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8db27198-f5bd-40b9-ade9-31352a85f2fd response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77892025-01-16T23:37:54.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 05bc063d-487a-4e0f-aa5d-4b3b0e3d5c62 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77902025-01-16T23:37:54.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 05bc063d-487a-4e0f-aa5d-4b3b0e3d5c62 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77912025-01-16T23:37:54.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 05bc063d-487a-4e0f-aa5d-4b3b0e3d5c62 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77922025-01-16T23:37:55.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 05a7e943-7b6f-4f63-bc5f-dcc9c31004b9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77932025-01-16T23:37:55.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 05a7e943-7b6f-4f63-bc5f-dcc9c31004b9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77942025-01-16T23:37:55.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 05a7e943-7b6f-4f63-bc5f-dcc9c31004b9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77952025-01-16T23:37:55.734ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 597 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 7efd14a1-f91e-4819-9bb1-7ebbe39eb25f response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
77962025-01-16T23:37:56.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a18d0a0b-1df7-46e5-b6f9-02646aa5816f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77972025-01-16T23:37:56.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a18d0a0b-1df7-46e5-b6f9-02646aa5816f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77982025-01-16T23:37:56.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a18d0a0b-1df7-46e5-b6f9-02646aa5816f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
77992025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
78002025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78012025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
78022025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
78032025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
78042025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
78052025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78062025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78072025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
78082025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78092025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
78102025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
78112025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
78122025-01-16T23:37:57.003ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
78132025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78142025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
78152025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78162025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
78172025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78182025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
78192025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78202025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
78212025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
78222025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
78232025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
78242025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78252025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
78262025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78272025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78282025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78292025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
78302025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78312025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78322025-01-16T23:37:57.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78332025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78342025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78352025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78362025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
78372025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78382025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78392025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78402025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78412025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
78422025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
78432025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78442025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
78452025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
78462025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78472025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
78482025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
78492025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78502025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78512025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
78522025-01-16T23:37:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
78532025-01-16T23:37:57.005ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78542025-01-16T23:37:57.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78552025-01-16T23:37:57.006ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.09768ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
78562025-01-16T23:37:57.006ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78572025-01-16T23:37:57.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78582025-01-16T23:37:57.009ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78592025-01-16T23:37:57.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78602025-01-16T23:37:57.011ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1785, tv_nsec: 324894134 } })
78612025-01-16T23:37:57.011ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1785, tv_nsec: 325303522 } })
78622025-01-16T23:37:57.011ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
78632025-01-16T23:37:57.012ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
78642025-01-16T23:37:57.022ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78652025-01-16T23:37:57.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78662025-01-16T23:37:57.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78672025-01-16T23:37:57.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78682025-01-16T23:37:57.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78692025-01-16T23:37:57.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78702025-01-16T23:37:57.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.248785ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
78712025-01-16T23:37:57.055ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78722025-01-16T23:37:57.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
78732025-01-16T23:37:57.056ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78742025-01-16T23:37:57.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78752025-01-16T23:37:57.057ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.487818ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
78762025-01-16T23:37:57.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78772025-01-16T23:37:57.057ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78782025-01-16T23:37:57.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78792025-01-16T23:37:57.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78802025-01-16T23:37:57.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
78812025-01-16T23:37:57.057ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
78822025-01-16T23:37:57.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78832025-01-16T23:37:57.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
78842025-01-16T23:37:57.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78852025-01-16T23:37:57.058ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.311902ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78862025-01-16T23:37:57.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78872025-01-16T23:37:57.059ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78882025-01-16T23:37:57.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78892025-01-16T23:37:57.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
78902025-01-16T23:37:57.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78912025-01-16T23:37:57.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78922025-01-16T23:37:57.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78932025-01-16T23:37:57.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78942025-01-16T23:37:57.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78952025-01-16T23:37:57.062ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78962025-01-16T23:37:57.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78972025-01-16T23:37:57.062ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78982025-01-16T23:37:57.062ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
78992025-01-16T23:37:57.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79002025-01-16T23:37:57.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79012025-01-16T23:37:57.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79022025-01-16T23:37:57.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79032025-01-16T23:37:57.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79042025-01-16T23:37:57.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79052025-01-16T23:37:57.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79062025-01-16T23:37:57.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79072025-01-16T23:37:57.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79082025-01-16T23:37:57.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79092025-01-16T23:37:57.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79102025-01-16T23:37:57.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
79112025-01-16T23:37:57.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79122025-01-16T23:37:57.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79132025-01-16T23:37:57.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79142025-01-16T23:37:57.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79152025-01-16T23:37:57.072ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1785, tv_nsec: 385807744 } })
79162025-01-16T23:37:57.072ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
79172025-01-16T23:37:57.073ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
79182025-01-16T23:37:57.073ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79192025-01-16T23:37:57.074ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "639aa3bc-7848-4d75-bbbc-0f84bc621fe9", "content-length": "26", "date": "Thu, 16 Jan 2025 23:37:56 GMT"} })
79202025-01-16T23:37:57.074ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79212025-01-16T23:37:57.075ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79222025-01-16T23:37:57.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79232025-01-16T23:37:57.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79242025-01-16T23:37:57.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79252025-01-16T23:37:57.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79262025-01-16T23:37:57.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79272025-01-16T23:37:57.092ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.647953ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79282025-01-16T23:37:57.092ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79292025-01-16T23:37:57.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79302025-01-16T23:37:57.094ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 89.439638ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79312025-01-16T23:37:57.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
79322025-01-16T23:37:57.094ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79332025-01-16T23:37:57.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79342025-01-16T23:37:57.094ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
79352025-01-16T23:37:57.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d96338c5-7782-4c4a-90ba-58e541d72a12 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
79362025-01-16T23:37:57.094ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 90.801694ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
79372025-01-16T23:37:57.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d96338c5-7782-4c4a-90ba-58e541d72a12 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
79382025-01-16T23:37:57.094ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79392025-01-16T23:37:57.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79402025-01-16T23:37:57.095ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79412025-01-16T23:37:57.096ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 92.981285ms iteration = 28 status = 0
79422025-01-16T23:37:57.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d96338c5-7782-4c4a-90ba-58e541d72a12 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
79432025-01-16T23:37:57.100ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
79442025-01-16T23:37:57.100ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79452025-01-16T23:37:57.100ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79462025-01-16T23:37:57.100ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
79472025-01-16T23:37:57.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79482025-01-16T23:37:57.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
79492025-01-16T23:37:57.100ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79502025-01-16T23:37:57.100ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0574a62a-3dc1-4124-bfad-f855ddab4036", "content-length": "26", "date": "Thu, 16 Jan 2025 23:37:56 GMT"} })
79512025-01-16T23:37:57.100ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79522025-01-16T23:37:57.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79532025-01-16T23:37:57.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79542025-01-16T23:37:57.102ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79552025-01-16T23:37:57.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79562025-01-16T23:37:57.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
79572025-01-16T23:37:57.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79582025-01-16T23:37:57.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79592025-01-16T23:37:57.132ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
79602025-01-16T23:37:57.132ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 129.231442ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
79612025-01-16T23:37:57.133ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 128.869615ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
79622025-01-16T23:37:57.134ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
79632025-01-16T23:37:57.134ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 131.253641ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
79642025-01-16T23:37:57.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79652025-01-16T23:37:57.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79662025-01-16T23:37:57.143ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79672025-01-16T23:37:57.143ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
79682025-01-16T23:37:57.143ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.295315ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
79692025-01-16T23:37:57.171ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
79702025-01-16T23:37:57.171ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79712025-01-16T23:37:57.171ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f91c3dcc-5c8f-4522-b90e-ae9ffc0f7407", "content-length": "26", "date": "Thu, 16 Jan 2025 23:37:56 GMT"} })
79722025-01-16T23:37:57.171ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79732025-01-16T23:37:57.174ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
79742025-01-16T23:37:57.179ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 175.578942ms iteration = 31 status = {"physical_disks_added":0}
79752025-01-16T23:37:57.196ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
79762025-01-16T23:37:57.196ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9dd0d67-4a37-4329-b3a9-c32ffe3dd97c", "content-length": "2", "date": "Thu, 16 Jan 2025 23:37:56 GMT"} })
79772025-01-16T23:37:57.198ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79782025-01-16T23:37:57.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79792025-01-16T23:37:57.200ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 197.173037ms iteration = 28 status = null
79802025-01-16T23:37:57.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79812025-01-16T23:37:57.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79822025-01-16T23:37:57.229ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79832025-01-16T23:37:57.231ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79842025-01-16T23:37:57.231ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79852025-01-16T23:37:57.231ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
79862025-01-16T23:37:57.231ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79872025-01-16T23:37:57.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79882025-01-16T23:37:57.233ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79892025-01-16T23:37:57.235ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79902025-01-16T23:37:57.235ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79912025-01-16T23:37:57.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79922025-01-16T23:37:57.238ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 235.048564ms iteration = 28 status = {}
79932025-01-16T23:37:57.242ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c14eebf8-67e3-4960-a907-cea99873c50c", "content-length": "372", "date": "Thu, 16 Jan 2025 23:37:57 GMT"} })
79942025-01-16T23:37:57.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79952025-01-16T23:37:57.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79962025-01-16T23:37:57.289ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
79972025-01-16T23:37:57.289ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
79982025-01-16T23:37:57.290ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7850252d-ee5f-4c7e-ba61-77e433d44546", "date": "Thu, 16 Jan 2025 23:37:57 GMT"} })
79992025-01-16T23:37:57.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80002025-01-16T23:37:57.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80012025-01-16T23:37:57.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80022025-01-16T23:37:57.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80032025-01-16T23:37:57.411ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
80042025-01-16T23:37:57.412ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0abf87d-4e91-4727-80e5-8ded53706c57", "content-length": "691", "date": "Thu, 16 Jan 2025 23:37:57 GMT"} })
80052025-01-16T23:37:57.412ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
80062025-01-16T23:37:57.412ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
80072025-01-16T23:37:57.412ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
80082025-01-16T23:37:57.412ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 409.147998ms iteration = 29 status = {}
80092025-01-16T23:37:57.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80102025-01-16T23:37:57.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80112025-01-16T23:37:57.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80122025-01-16T23:37:57.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80132025-01-16T23:37:57.418ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
80142025-01-16T23:37:57.418ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80152025-01-16T23:37:57.418ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "82907fcd-fca4-44d7-8a6e-179b178a7989", "date": "Thu, 16 Jan 2025 23:37:57 GMT"} })
80162025-01-16T23:37:57.418ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
80172025-01-16T23:37:57.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80182025-01-16T23:37:57.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80192025-01-16T23:37:57.420ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 417.178813ms iteration = 29 status = {}
80202025-01-16T23:37:57.428ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
80212025-01-16T23:37:57.428ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3ec03d9-edf3-47ab-8714-ca8855e6322c", "content-length": "134", "date": "Thu, 16 Jan 2025 23:37:56 GMT"} })
80222025-01-16T23:37:57.428ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
80232025-01-16T23:37:57.428ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
80242025-01-16T23:37:57.428ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
80252025-01-16T23:37:57.429ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80262025-01-16T23:37:57.429ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80272025-01-16T23:37:57.429ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80282025-01-16T23:37:57.429ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80292025-01-16T23:37:57.429ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80302025-01-16T23:37:57.429ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80312025-01-16T23:37:57.429ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80322025-01-16T23:37:57.429ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
80332025-01-16T23:37:57.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80342025-01-16T23:37:57.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80352025-01-16T23:37:57.431ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
80362025-01-16T23:37:57.431ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "75683140-ece4-48b9-ba2d-7327782bb327", "content-length": "2", "date": "Thu, 16 Jan 2025 23:37:56 GMT"} })
80372025-01-16T23:37:57.431ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
80382025-01-16T23:37:57.431ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cce48977-518c-4aeb-ab70-2399e18b6551", "content-length": "52", "date": "Thu, 16 Jan 2025 23:37:57 GMT"} })
80392025-01-16T23:37:57.431ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
80402025-01-16T23:37:57.431ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
80412025-01-16T23:37:57.523ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0d3d6cd3-31d6-40d1-bf83-11d1671baab9", "date": "Thu, 16 Jan 2025 23:37:57 GMT"} })
80422025-01-16T23:37:57.523ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
80432025-01-16T23:37:57.523ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
80442025-01-16T23:37:57.523ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b54c7ffe-039f-4cb6-af98-b62d2447685b", "content-length": "682", "date": "Thu, 16 Jan 2025 23:37:57 GMT"} })
80452025-01-16T23:37:57.523ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80462025-01-16T23:37:57.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80472025-01-16T23:37:57.527ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80482025-01-16T23:37:57.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80492025-01-16T23:37:57.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80502025-01-16T23:37:57.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80512025-01-16T23:37:57.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80522025-01-16T23:37:57.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80532025-01-16T23:37:57.540ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 536.676257ms iteration = 28 status = {}
80542025-01-16T23:37:58.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 67f53004-6b8a-4213-a3bc-e2a80cfe657d roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80552025-01-16T23:37:58.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 67f53004-6b8a-4213-a3bc-e2a80cfe657d resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80562025-01-16T23:37:58.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 67f53004-6b8a-4213-a3bc-e2a80cfe657d response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80572025-01-16T23:37:58.169ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
80582025-01-16T23:37:58.169ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
80592025-01-16T23:37:58.200ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
80602025-01-16T23:37:58.200ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:61639
80612025-01-16T23:37:58.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61639 req_id = 9c7544de-e6cb-4bda-9999-63201cb36ab6 roles = RoleSet { roles: {} } uri = /metrics/producers
80622025-01-16T23:37:58.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61639 req_id = 9c7544de-e6cb-4bda-9999-63201cb36ab6 resource = Database result = Ok(()) uri = /metrics/producers
80632025-01-16T23:37:58.240ZINFOnexus: assigned collector to new producer collector_id = 0a365f9e-6c70-4a27-ba2b-6123ad53013e file = nexus/src/app/oximeter.rs:76 producer_id = 1d7f4b38-ce97-4d7c-b37c-92212a02a45f
80642025-01-16T23:37:58.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40039 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61639 req_id = 9c7544de-e6cb-4bda-9999-63201cb36ab6 response_code = 201 uri = /metrics/producers
80652025-01-16T23:37:58.240ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9c7544de-e6cb-4bda-9999-63201cb36ab6", "content-length": "41", "date": "Thu, 16 Jan 2025 23:37:58 GMT"} })
80662025-01-16T23:37:58.242ZDEBGnexus (producer-registration-task): registered with nexus successfully
80672025-01-16T23:37:58.242ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
80682025-01-16T23:37:59.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 74fcf96f-3fe7-4b23-9b63-3a75b8215f5e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80692025-01-16T23:37:59.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 74fcf96f-3fe7-4b23-9b63-3a75b8215f5e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80702025-01-16T23:37:59.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1819 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 74fcf96f-3fe7-4b23-9b63-3a75b8215f5e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80712025-01-16T23:38:00.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8a87496e-09f5-4c22-8584-e0bcb5e9f31a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80722025-01-16T23:38:00.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8a87496e-09f5-4c22-8584-e0bcb5e9f31a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80732025-01-16T23:38:00.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8a87496e-09f5-4c22-8584-e0bcb5e9f31a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80742025-01-16T23:38:01.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 97dcc9a7-efbe-4f55-9ed3-1a10e85ebbf2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80752025-01-16T23:38:01.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 97dcc9a7-efbe-4f55-9ed3-1a10e85ebbf2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80762025-01-16T23:38:01.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 97dcc9a7-efbe-4f55-9ed3-1a10e85ebbf2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80772025-01-16T23:38:02.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bdc1c2e8-c8b6-4020-9340-ae95ee3cead3 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80782025-01-16T23:38:02.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bdc1c2e8-c8b6-4020-9340-ae95ee3cead3 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80792025-01-16T23:38:02.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bdc1c2e8-c8b6-4020-9340-ae95ee3cead3 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80802025-01-16T23:38:03.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0d88e2af-fe01-4132-9747-e76bd26e129a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80812025-01-16T23:38:03.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0d88e2af-fe01-4132-9747-e76bd26e129a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80822025-01-16T23:38:03.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2719 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0d88e2af-fe01-4132-9747-e76bd26e129a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80832025-01-16T23:38:04.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5bb2071c-9b78-41b6-8318-d1b86196f025 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80842025-01-16T23:38:04.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5bb2071c-9b78-41b6-8318-d1b86196f025 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80852025-01-16T23:38:04.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5bb2071c-9b78-41b6-8318-d1b86196f025 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80862025-01-16T23:38:05.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4d82be91-c483-41d3-98d7-dd812ee7e752 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80872025-01-16T23:38:05.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4d82be91-c483-41d3-98d7-dd812ee7e752 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80882025-01-16T23:38:05.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4d82be91-c483-41d3-98d7-dd812ee7e752 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80892025-01-16T23:38:05.735ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 584 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 639cb3ab-6fc6-4bf2-a3f5-2800037cb3d0 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
80902025-01-16T23:38:06.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 007eb870-7c87-4df7-b0f0-407c43ea39ab roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80912025-01-16T23:38:06.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 007eb870-7c87-4df7-b0f0-407c43ea39ab resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80922025-01-16T23:38:06.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 007eb870-7c87-4df7-b0f0-407c43ea39ab response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
80932025-01-16T23:38:07.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
80942025-01-16T23:38:07.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80952025-01-16T23:38:07.004ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
80962025-01-16T23:38:07.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80972025-01-16T23:38:07.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80982025-01-16T23:38:07.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80992025-01-16T23:38:07.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81002025-01-16T23:38:07.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81012025-01-16T23:38:07.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81022025-01-16T23:38:07.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81032025-01-16T23:38:07.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81042025-01-16T23:38:07.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81052025-01-16T23:38:07.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81062025-01-16T23:38:07.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81072025-01-16T23:38:07.036ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.062635ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81082025-01-16T23:38:07.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81092025-01-16T23:38:07.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
81102025-01-16T23:38:07.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81112025-01-16T23:38:07.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81122025-01-16T23:38:07.058ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
81132025-01-16T23:38:07.058ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.016786ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
81142025-01-16T23:38:07.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 455d4f78-fa3d-435d-830b-36a3d67fd9c5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81152025-01-16T23:38:07.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 455d4f78-fa3d-435d-830b-36a3d67fd9c5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81162025-01-16T23:38:07.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 455d4f78-fa3d-435d-830b-36a3d67fd9c5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81172025-01-16T23:38:08.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ff60b822-73fd-4abb-aa58-3e20c6e89cc2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81182025-01-16T23:38:08.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ff60b822-73fd-4abb-aa58-3e20c6e89cc2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81192025-01-16T23:38:08.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ff60b822-73fd-4abb-aa58-3e20c6e89cc2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81202025-01-16T23:38:09.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c1f872ec-d78d-4b28-bfd0-38e04c5186ab roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81212025-01-16T23:38:09.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c1f872ec-d78d-4b28-bfd0-38e04c5186ab resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81222025-01-16T23:38:09.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c1f872ec-d78d-4b28-bfd0-38e04c5186ab response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81232025-01-16T23:38:10.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 259bf2cd-dedc-42a1-8209-c1d68c2e172a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81242025-01-16T23:38:10.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 259bf2cd-dedc-42a1-8209-c1d68c2e172a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81252025-01-16T23:38:10.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 259bf2cd-dedc-42a1-8209-c1d68c2e172a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81262025-01-16T23:38:11.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2c82cee9-a74d-4641-87cb-1ad680a8630e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81272025-01-16T23:38:11.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2c82cee9-a74d-4641-87cb-1ad680a8630e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81282025-01-16T23:38:11.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2c82cee9-a74d-4641-87cb-1ad680a8630e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81292025-01-16T23:38:12.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4dc8764e-763f-42e3-95f9-ae48e1dd80a4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81302025-01-16T23:38:12.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4dc8764e-763f-42e3-95f9-ae48e1dd80a4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81312025-01-16T23:38:12.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4dc8764e-763f-42e3-95f9-ae48e1dd80a4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81322025-01-16T23:38:13.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fdf2454f-2c85-4759-aa91-16ad30496ba1 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81332025-01-16T23:38:13.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fdf2454f-2c85-4759-aa91-16ad30496ba1 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81342025-01-16T23:38:13.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fdf2454f-2c85-4759-aa91-16ad30496ba1 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81352025-01-16T23:38:14.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4175657e-7637-44ed-9705-19ee6db77fc0 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81362025-01-16T23:38:14.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4175657e-7637-44ed-9705-19ee6db77fc0 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81372025-01-16T23:38:14.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2775 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4175657e-7637-44ed-9705-19ee6db77fc0 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81382025-01-16T23:38:15.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 413d54c4-a438-4982-848e-f295bc7e0154 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81392025-01-16T23:38:15.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 413d54c4-a438-4982-848e-f295bc7e0154 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81402025-01-16T23:38:15.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 413d54c4-a438-4982-848e-f295bc7e0154 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81412025-01-16T23:38:15.734ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 610 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 921ab113-de4f-40aa-ada5-62514bbee2b9 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
81422025-01-16T23:38:16.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6ba3013b-ec69-4fba-b68d-080246ff37bb roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81432025-01-16T23:38:16.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6ba3013b-ec69-4fba-b68d-080246ff37bb resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81442025-01-16T23:38:16.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6ba3013b-ec69-4fba-b68d-080246ff37bb response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81452025-01-16T23:38:17.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
81462025-01-16T23:38:17.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81472025-01-16T23:38:17.003ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
81482025-01-16T23:38:17.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81492025-01-16T23:38:17.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81502025-01-16T23:38:17.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81512025-01-16T23:38:17.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81522025-01-16T23:38:17.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81532025-01-16T23:38:17.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81542025-01-16T23:38:17.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81552025-01-16T23:38:17.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81562025-01-16T23:38:17.008ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.67628ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81572025-01-16T23:38:17.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81582025-01-16T23:38:17.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81592025-01-16T23:38:17.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81602025-01-16T23:38:17.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81612025-01-16T23:38:17.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
81622025-01-16T23:38:17.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81632025-01-16T23:38:17.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81642025-01-16T23:38:17.023ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
81652025-01-16T23:38:17.023ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.582886ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
81662025-01-16T23:38:17.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 49fadde0-a1dc-48ea-aca5-f6f63223a3ed roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81672025-01-16T23:38:17.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 49fadde0-a1dc-48ea-aca5-f6f63223a3ed resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81682025-01-16T23:38:17.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 49fadde0-a1dc-48ea-aca5-f6f63223a3ed response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81692025-01-16T23:38:18.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 20e19152-288f-4d38-9080-014d7990e168 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81702025-01-16T23:38:18.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 20e19152-288f-4d38-9080-014d7990e168 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81712025-01-16T23:38:18.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 20e19152-288f-4d38-9080-014d7990e168 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81722025-01-16T23:38:19.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ab43e29f-674e-46be-81f6-7d61bdaf72f8 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81732025-01-16T23:38:19.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ab43e29f-674e-46be-81f6-7d61bdaf72f8 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81742025-01-16T23:38:19.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ab43e29f-674e-46be-81f6-7d61bdaf72f8 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81752025-01-16T23:38:20.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = af627e3f-b97f-4073-9ec0-b4c79a4e04fd roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81762025-01-16T23:38:20.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = af627e3f-b97f-4073-9ec0-b4c79a4e04fd resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81772025-01-16T23:38:20.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = af627e3f-b97f-4073-9ec0-b4c79a4e04fd response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81782025-01-16T23:38:21.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6583119e-0eac-4e34-b713-d129f16dbf08 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81792025-01-16T23:38:21.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6583119e-0eac-4e34-b713-d129f16dbf08 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81802025-01-16T23:38:21.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6583119e-0eac-4e34-b713-d129f16dbf08 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81812025-01-16T23:38:22.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 80b3dc36-99ae-482a-9827-d5bf98691e3f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81822025-01-16T23:38:22.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 80b3dc36-99ae-482a-9827-d5bf98691e3f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81832025-01-16T23:38:22.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 80b3dc36-99ae-482a-9827-d5bf98691e3f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81842025-01-16T23:38:23.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4137f74d-f828-4eb9-bf58-f0e202251dfd roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81852025-01-16T23:38:23.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4137f74d-f828-4eb9-bf58-f0e202251dfd resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81862025-01-16T23:38:23.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4137f74d-f828-4eb9-bf58-f0e202251dfd response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81872025-01-16T23:38:24.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 39a8055b-2b3a-493e-abb7-e7acd57530dd roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81882025-01-16T23:38:24.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 39a8055b-2b3a-493e-abb7-e7acd57530dd resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81892025-01-16T23:38:24.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 39a8055b-2b3a-493e-abb7-e7acd57530dd response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81902025-01-16T23:38:25.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 346ef3ff-2de2-4186-a829-56a391d58f42 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81912025-01-16T23:38:25.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 346ef3ff-2de2-4186-a829-56a391d58f42 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81922025-01-16T23:38:25.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 346ef3ff-2de2-4186-a829-56a391d58f42 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81932025-01-16T23:38:25.735ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 657 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = c4914035-b03b-4e71-885c-75ec0a51426f response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
81942025-01-16T23:38:26.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 65b869ef-3b75-4937-9db9-1cd38c870e2a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81952025-01-16T23:38:26.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 65b869ef-3b75-4937-9db9-1cd38c870e2a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81962025-01-16T23:38:26.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 65b869ef-3b75-4937-9db9-1cd38c870e2a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
81972025-01-16T23:38:27.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
81982025-01-16T23:38:27.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81992025-01-16T23:38:27.003ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
82002025-01-16T23:38:27.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82012025-01-16T23:38:27.003ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
82022025-01-16T23:38:27.003ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
82032025-01-16T23:38:27.003ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82042025-01-16T23:38:27.003ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
82052025-01-16T23:38:27.003ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
82062025-01-16T23:38:27.003ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-16 23:28:27.003893071 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
82072025-01-16T23:38:27.003ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
82082025-01-16T23:38:27.003ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
82092025-01-16T23:38:27.003ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
82102025-01-16T23:38:27.003ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
82112025-01-16T23:38:27.003ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
82122025-01-16T23:38:27.004ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca
82132025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.29\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca"}
82142025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
82152025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
82162025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82172025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
82182025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82192025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
82202025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
82212025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82222025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
82232025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
82242025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
82252025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82262025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
82272025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
82282025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82292025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
82302025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82312025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
82322025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82332025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
82342025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82352025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
82362025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
82372025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
82382025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82392025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
82402025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82412025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
82422025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
82432025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 29 reason = Timeout
82442025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82452025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
82462025-01-16T23:38:27.004ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
82472025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
82482025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82492025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
82502025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
82512025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
82522025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82532025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
82542025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
82552025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
82562025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82572025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
82582025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
82592025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
82602025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
82612025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82622025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82632025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82642025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
82652025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82662025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
82672025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
82682025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82692025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82702025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
82712025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82722025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82732025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82742025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82752025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82762025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82772025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
82782025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
82792025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82802025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
82812025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82822025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82832025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
82842025-01-16T23:38:27.004ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dc5f3810-93b6-44f1-815c-44411abf99ad.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1815, tv_nsec: 317924840 } })
82852025-01-16T23:38:27.004ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5c1ab32c-50b8-4564-bf29-e388b915cbdb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd10c057-8c9f-4db2-98b5-bcf5e0d536ba.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1815, tv_nsec: 317925180 } })
82862025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
82872025-01-16T23:38:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
82882025-01-16T23:38:27.005ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
82892025-01-16T23:38:27.005ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.321065ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
82902025-01-16T23:38:27.005ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
82912025-01-16T23:38:27.005ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.517889ms iteration = 15 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
82922025-01-16T23:38:27.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82932025-01-16T23:38:27.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82942025-01-16T23:38:27.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82952025-01-16T23:38:27.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82962025-01-16T23:38:27.008ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.142779ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
82972025-01-16T23:38:27.008ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1815, tv_nsec: 321402837 } })
82982025-01-16T23:38:27.008ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-16 23:28:27.003893071 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
82992025-01-16T23:38:27.008ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.604209ms iteration = 15 status = {"expiration":"2025-01-16T23:28:27.003893071Z","pruned":[]}
83002025-01-16T23:38:27.008ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
83012025-01-16T23:38:27.009ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1815, tv_nsec: 322725122 } })
83022025-01-16T23:38:27.009ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
83032025-01-16T23:38:27.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83042025-01-16T23:38:27.010ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83052025-01-16T23:38:27.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83062025-01-16T23:38:27.011ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83072025-01-16T23:38:27.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83082025-01-16T23:38:27.013ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83092025-01-16T23:38:27.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83102025-01-16T23:38:27.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
83112025-01-16T23:38:27.014ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
83122025-01-16T23:38:27.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
83132025-01-16T23:38:27.014ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
83142025-01-16T23:38:27.014ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83152025-01-16T23:38:27.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83162025-01-16T23:38:27.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83172025-01-16T23:38:27.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83182025-01-16T23:38:27.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83192025-01-16T23:38:27.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83202025-01-16T23:38:27.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83212025-01-16T23:38:27.017ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83222025-01-16T23:38:27.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83232025-01-16T23:38:27.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83242025-01-16T23:38:27.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
83252025-01-16T23:38:27.020ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
83262025-01-16T23:38:27.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
83272025-01-16T23:38:27.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83282025-01-16T23:38:27.025ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.551634ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
83292025-01-16T23:38:27.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
83302025-01-16T23:38:27.031ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83312025-01-16T23:38:27.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83322025-01-16T23:38:27.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83332025-01-16T23:38:27.037ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83342025-01-16T23:38:27.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83352025-01-16T23:38:27.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83362025-01-16T23:38:27.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
83372025-01-16T23:38:27.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83382025-01-16T23:38:27.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83392025-01-16T23:38:27.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
83402025-01-16T23:38:27.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83412025-01-16T23:38:27.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83422025-01-16T23:38:27.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83432025-01-16T23:38:27.056ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83442025-01-16T23:38:27.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83452025-01-16T23:38:27.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
83462025-01-16T23:38:27.059ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83472025-01-16T23:38:27.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83482025-01-16T23:38:27.061ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83492025-01-16T23:38:27.061ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
83502025-01-16T23:38:27.061ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83512025-01-16T23:38:27.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83522025-01-16T23:38:27.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
83532025-01-16T23:38:27.061ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83542025-01-16T23:38:27.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83552025-01-16T23:38:27.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83562025-01-16T23:38:27.062ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83572025-01-16T23:38:27.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83582025-01-16T23:38:27.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83592025-01-16T23:38:27.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
83602025-01-16T23:38:27.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83612025-01-16T23:38:27.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83622025-01-16T23:38:27.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83632025-01-16T23:38:27.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83642025-01-16T23:38:27.067ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83652025-01-16T23:38:27.067ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
83662025-01-16T23:38:27.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83672025-01-16T23:38:27.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83682025-01-16T23:38:27.069ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1815, tv_nsec: 382219525 } })
83692025-01-16T23:38:27.069ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83702025-01-16T23:38:27.069ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
83712025-01-16T23:38:27.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83722025-01-16T23:38:27.074ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
83732025-01-16T23:38:27.074ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
83742025-01-16T23:38:27.074ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.810641ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
83752025-01-16T23:38:27.074ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.699678ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
83762025-01-16T23:38:27.076ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83772025-01-16T23:38:27.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.035302ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83782025-01-16T23:38:27.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83792025-01-16T23:38:27.079ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83802025-01-16T23:38:27.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83812025-01-16T23:38:27.083ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 79.232122ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
83822025-01-16T23:38:27.086ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
83832025-01-16T23:38:27.086ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
83842025-01-16T23:38:27.086ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
83852025-01-16T23:38:27.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83862025-01-16T23:38:27.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 82.704349ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83872025-01-16T23:38:27.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83882025-01-16T23:38:27.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83892025-01-16T23:38:27.088ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83902025-01-16T23:38:27.088ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
83912025-01-16T23:38:27.088ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
83922025-01-16T23:38:27.088ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
83932025-01-16T23:38:27.088ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 84.757368ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
83942025-01-16T23:38:27.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
83952025-01-16T23:38:27.089ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83962025-01-16T23:38:27.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83972025-01-16T23:38:27.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
83982025-01-16T23:38:27.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83992025-01-16T23:38:27.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84002025-01-16T23:38:27.090ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
84012025-01-16T23:38:27.090ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
84022025-01-16T23:38:27.090ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
84032025-01-16T23:38:27.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84042025-01-16T23:38:27.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84052025-01-16T23:38:27.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84062025-01-16T23:38:27.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84072025-01-16T23:38:27.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84082025-01-16T23:38:27.092ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84092025-01-16T23:38:27.093ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84102025-01-16T23:38:27.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
84112025-01-16T23:38:27.096ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84122025-01-16T23:38:27.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84132025-01-16T23:38:27.097ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
84142025-01-16T23:38:27.097ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.338173ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
84152025-01-16T23:38:27.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84162025-01-16T23:38:27.098ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84172025-01-16T23:38:27.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84182025-01-16T23:38:27.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84192025-01-16T23:38:27.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84202025-01-16T23:38:27.106ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
84212025-01-16T23:38:27.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
84222025-01-16T23:38:27.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84232025-01-16T23:38:27.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84242025-01-16T23:38:27.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84252025-01-16T23:38:27.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84262025-01-16T23:38:27.111ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84272025-01-16T23:38:27.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84282025-01-16T23:38:27.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84292025-01-16T23:38:27.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
84302025-01-16T23:38:27.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84312025-01-16T23:38:27.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84322025-01-16T23:38:27.119ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 115.656912ms iteration = 29 status = 0
84332025-01-16T23:38:27.125ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84342025-01-16T23:38:27.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84352025-01-16T23:38:27.127ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84362025-01-16T23:38:27.129ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
84372025-01-16T23:38:27.129ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84382025-01-16T23:38:27.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84392025-01-16T23:38:27.132ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
84402025-01-16T23:38:27.132ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 128.093531ms iteration = 29 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
84412025-01-16T23:38:27.136ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84422025-01-16T23:38:27.136ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 132.469524ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
84432025-01-16T23:38:27.136ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 132.628337ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
84442025-01-16T23:38:27.137ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84452025-01-16T23:38:27.137ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84462025-01-16T23:38:27.137ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 133.200428ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84472025-01-16T23:38:27.140ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84482025-01-16T23:38:27.142ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 137.912569ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84492025-01-16T23:38:27.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84502025-01-16T23:38:27.144ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84512025-01-16T23:38:27.144ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
84522025-01-16T23:38:27.144ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
84532025-01-16T23:38:27.144ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84542025-01-16T23:38:27.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84552025-01-16T23:38:27.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84562025-01-16T23:38:27.146ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84572025-01-16T23:38:27.150ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84582025-01-16T23:38:27.150ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84592025-01-16T23:38:27.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84602025-01-16T23:38:27.153ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
84612025-01-16T23:38:27.153ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
84622025-01-16T23:38:27.153ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-16 23:25:20.756297 UTC dns_group = internal generation = 1
84632025-01-16T23:38:27.153ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 149.610464ms iteration = 15 status = {"generation":1}
84642025-01-16T23:38:27.168ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84652025-01-16T23:38:27.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84662025-01-16T23:38:27.170ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84672025-01-16T23:38:27.171ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84682025-01-16T23:38:27.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84692025-01-16T23:38:27.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84702025-01-16T23:38:27.174ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-16T23:24:20.471931Z, time_modified: 2025-01-16T23:24:20.471931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }) }
84712025-01-16T23:38:27.174ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 170.22221ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]}},"default_endpoint":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
84722025-01-16T23:38:27.175ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84732025-01-16T23:38:27.176ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
84742025-01-16T23:38:27.176ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 0 version = 2
84752025-01-16T23:38:27.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84762025-01-16T23:38:27.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84772025-01-16T23:38:27.177ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
84782025-01-16T23:38:27.177ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84792025-01-16T23:38:27.177ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7bb6c14-e6c7-410d-b9b0-bb5b93c3bd5e", "content-length": "26", "date": "Thu, 16 Jan 2025 23:38:26 GMT"} })
84802025-01-16T23:38:27.177ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84812025-01-16T23:38:27.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84822025-01-16T23:38:27.178ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84832025-01-16T23:38:27.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84842025-01-16T23:38:27.179ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84852025-01-16T23:38:27.179ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84862025-01-16T23:38:27.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84872025-01-16T23:38:27.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84882025-01-16T23:38:27.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84892025-01-16T23:38:27.183ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 1 version = 2
84902025-01-16T23:38:27.183ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
84912025-01-16T23:38:27.183ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-16 23:25:21.695734 UTC dns_group = external generation = 2
84922025-01-16T23:38:27.183ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 179.829804ms iteration = 15 status = {"generation":2}
84932025-01-16T23:38:27.201ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
84942025-01-16T23:38:27.201ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 197.411041ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
84952025-01-16T23:38:27.210ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 206.960624ms iteration = 32 status = {"physical_disks_added":0}
84962025-01-16T23:38:27.253ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
84972025-01-16T23:38:27.291ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
84982025-01-16T23:38:27.388ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
84992025-01-16T23:38:27.388ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85002025-01-16T23:38:27.388ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dda4dc0-80fa-4dbb-8793-53b1e96cf5ae", "content-length": "26", "date": "Thu, 16 Jan 2025 23:38:26 GMT"} })
85012025-01-16T23:38:27.388ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85022025-01-16T23:38:27.390ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85032025-01-16T23:38:27.406ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
85042025-01-16T23:38:27.406ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85052025-01-16T23:38:27.406ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4e21381-d1f7-4b7d-b65b-06379f1481f4", "content-length": "26", "date": "Thu, 16 Jan 2025 23:38:26 GMT"} })
85062025-01-16T23:38:27.406ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85072025-01-16T23:38:27.408ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
85082025-01-16T23:38:27.420ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
85092025-01-16T23:38:27.421ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4b21acb-713f-43af-b805-14610061bcf6", "content-length": "2", "date": "Thu, 16 Jan 2025 23:38:27 GMT"} })
85102025-01-16T23:38:27.421ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85112025-01-16T23:38:27.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85122025-01-16T23:38:27.424ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 420.321173ms iteration = 29 status = null
85132025-01-16T23:38:27.441ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
85142025-01-16T23:38:27.441ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85152025-01-16T23:38:27.441ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a05a375-b684-4f66-8f8a-06c3b6361461", "content-length": "372", "date": "Thu, 16 Jan 2025 23:38:27 GMT"} })
85162025-01-16T23:38:27.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85172025-01-16T23:38:27.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85182025-01-16T23:38:27.482ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
85192025-01-16T23:38:27.482ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
85202025-01-16T23:38:27.482ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4e7906be-fb4d-4f17-856b-48e79c7f2c5b", "date": "Thu, 16 Jan 2025 23:38:27 GMT"} })
85212025-01-16T23:38:27.482ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85222025-01-16T23:38:27.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85232025-01-16T23:38:27.485ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85242025-01-16T23:38:27.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85252025-01-16T23:38:27.489ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
85262025-01-16T23:38:27.489ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ef90665a-32be-4543-b182-05cce6422cdf", "date": "Thu, 16 Jan 2025 23:38:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85272025-01-16T23:38:27.489ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85282025-01-16T23:38:27.491ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d146f313-8cbc-4108-bf78-3f814ff8ef6a", "date": "Thu, 16 Jan 2025 23:38:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85292025-01-16T23:38:27.491ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85302025-01-16T23:38:27.492ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85312025-01-16T23:38:27.492ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 488.865109ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
85322025-01-16T23:38:27.529ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 525.617724ms iteration = 29 status = {}
85332025-01-16T23:38:27.614ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85342025-01-16T23:38:27.614ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf3e3526-c697-4cb7-81e4-3ebcb80f59a8", "content-length": "691", "date": "Thu, 16 Jan 2025 23:38:27 GMT"} })
85352025-01-16T23:38:27.614ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
85362025-01-16T23:38:27.615ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
85372025-01-16T23:38:27.615ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
85382025-01-16T23:38:27.616ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 612.790749ms iteration = 30 status = {}
85392025-01-16T23:38:27.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85402025-01-16T23:38:27.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85412025-01-16T23:38:27.621ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85422025-01-16T23:38:27.621ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85432025-01-16T23:38:27.621ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8392bca2-79ed-4f08-b6ca-c7dc6557fc49", "date": "Thu, 16 Jan 2025 23:38:27 GMT"} })
85442025-01-16T23:38:27.623ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 619.497287ms iteration = 30 status = {}
85452025-01-16T23:38:27.624ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
85462025-01-16T23:38:27.742ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
85472025-01-16T23:38:27.743ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8197cfcf-ea8e-4535-88d8-a307bbad6866", "date": "Thu, 16 Jan 2025 23:38:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85482025-01-16T23:38:27.743ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85492025-01-16T23:38:27.745ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "87ad8d89-7e32-4606-b1e4-9c7cbafb9dfe", "date": "Thu, 16 Jan 2025 23:38:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85502025-01-16T23:38:27.745ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85512025-01-16T23:38:27.747ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4f311ce0-3af3-44d4-b3e9-933dbf1fd2e9", "date": "Thu, 16 Jan 2025 23:38:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85522025-01-16T23:38:27.747ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85532025-01-16T23:38:27.748ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85542025-01-16T23:38:27.748ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 744.590209ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
85552025-01-16T23:38:27.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d6f7e767-5d72-4b1a-a061-be9e83525065 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
85562025-01-16T23:38:27.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d6f7e767-5d72-4b1a-a061-be9e83525065 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
85572025-01-16T23:38:27.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d6f7e767-5d72-4b1a-a061-be9e83525065 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
85582025-01-16T23:38:27.788ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85592025-01-16T23:38:27.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85602025-01-16T23:38:27.791ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
85612025-01-16T23:38:27.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85622025-01-16T23:38:27.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85632025-01-16T23:38:27.801ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
85642025-01-16T23:38:27.801ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c857cc39-ee7e-4df9-884b-21f54bf02a6a", "content-length": "134", "date": "Thu, 16 Jan 2025 23:38:27 GMT"} })
85652025-01-16T23:38:27.801ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
85662025-01-16T23:38:27.801ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
85672025-01-16T23:38:27.802ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85682025-01-16T23:38:27.802ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85692025-01-16T23:38:27.802ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85702025-01-16T23:38:27.802ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85712025-01-16T23:38:27.802ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85722025-01-16T23:38:27.802ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85732025-01-16T23:38:27.802ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85742025-01-16T23:38:27.802ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85752025-01-16T23:38:27.802ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
85762025-01-16T23:38:27.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85772025-01-16T23:38:27.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85782025-01-16T23:38:27.804ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
85792025-01-16T23:38:27.804ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "14560286-afaf-425e-a2ab-1ed761eaa2b4", "content-length": "2", "date": "Thu, 16 Jan 2025 23:38:27 GMT"} })
85802025-01-16T23:38:27.804ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
85812025-01-16T23:38:27.805ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8668cdd-180b-4c11-95ba-8793a302f18a", "content-length": "52", "date": "Thu, 16 Jan 2025 23:38:27 GMT"} })
85822025-01-16T23:38:27.805ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
85832025-01-16T23:38:27.805ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85842025-01-16T23:38:27.901ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "588071ae-d6ef-40fa-92a9-9546f97f72ae", "date": "Thu, 16 Jan 2025 23:38:27 GMT"} })
85852025-01-16T23:38:27.901ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
85862025-01-16T23:38:27.901ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
85872025-01-16T23:38:27.901ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f717c5f7-3f25-45d8-bff7-8eba37355ef6", "content-length": "682", "date": "Thu, 16 Jan 2025 23:38:27 GMT"} })
85882025-01-16T23:38:27.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85892025-01-16T23:38:27.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85902025-01-16T23:38:27.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85912025-01-16T23:38:27.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85922025-01-16T23:38:27.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85932025-01-16T23:38:27.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85942025-01-16T23:38:27.912ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85952025-01-16T23:38:27.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85962025-01-16T23:38:27.920ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 916.134174ms iteration = 29 status = {}
85972025-01-16T23:38:28.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7b85f658-9bb2-4993-bbb9-3a10e8e3531b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
85982025-01-16T23:38:28.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7b85f658-9bb2-4993-bbb9-3a10e8e3531b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
85992025-01-16T23:38:28.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1819 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 7b85f658-9bb2-4993-bbb9-3a10e8e3531b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86002025-01-16T23:38:29.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 754a66a6-e0f8-4883-b9c0-76925989196c roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86012025-01-16T23:38:29.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 754a66a6-e0f8-4883-b9c0-76925989196c resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86022025-01-16T23:38:29.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 754a66a6-e0f8-4883-b9c0-76925989196c response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86032025-01-16T23:38:30.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8107b522-65cd-449a-8030-935b45bcf670 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86042025-01-16T23:38:30.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8107b522-65cd-449a-8030-935b45bcf670 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86052025-01-16T23:38:30.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8107b522-65cd-449a-8030-935b45bcf670 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86062025-01-16T23:38:31.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6b3b4062-7147-44f3-b483-8112b32a82e6 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86072025-01-16T23:38:31.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6b3b4062-7147-44f3-b483-8112b32a82e6 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86082025-01-16T23:38:31.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6b3b4062-7147-44f3-b483-8112b32a82e6 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86092025-01-16T23:38:32.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1ecf03aa-b9e8-461f-87b4-77668bab7421 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86102025-01-16T23:38:32.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1ecf03aa-b9e8-461f-87b4-77668bab7421 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86112025-01-16T23:38:32.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1ecf03aa-b9e8-461f-87b4-77668bab7421 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86122025-01-16T23:38:33.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 64c5b56c-4383-48fe-b421-d2039ff7be46 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86132025-01-16T23:38:33.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 64c5b56c-4383-48fe-b421-d2039ff7be46 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86142025-01-16T23:38:33.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 64c5b56c-4383-48fe-b421-d2039ff7be46 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86152025-01-16T23:38:34.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = af7d2586-08cd-40b9-ac9e-496f30ffe838 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86162025-01-16T23:38:34.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = af7d2586-08cd-40b9-ac9e-496f30ffe838 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86172025-01-16T23:38:34.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2735 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = af7d2586-08cd-40b9-ac9e-496f30ffe838 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86182025-01-16T23:38:35.725ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:47848
86192025-01-16T23:38:35.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 6dcb851a-c46a-4754-9ca4-935df7b7b604 roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
86202025-01-16T23:38:35.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 6dcb851a-c46a-4754-9ca4-935df7b7b604 resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
86212025-01-16T23:38:35.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 6dcb851a-c46a-4754-9ca4-935df7b7b604 response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
86222025-01-16T23:38:35.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 41abe562-6ded-4632-873d-a6542c97b5b3 roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
86232025-01-16T23:38:35.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 41abe562-6ded-4632-873d-a6542c97b5b3 resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
86242025-01-16T23:38:35.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 41abe562-6ded-4632-873d-a6542c97b5b3 response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
86252025-01-16T23:38:35.735ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 592 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 590bbb73-d5e2-4d01-a8bd-2e9e1f4b2174 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
86262025-01-16T23:38:35.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f21b51b5-ff4a-4e36-9dc9-f9847d5439f1 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86272025-01-16T23:38:35.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f21b51b5-ff4a-4e36-9dc9-f9847d5439f1 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86282025-01-16T23:38:35.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f21b51b5-ff4a-4e36-9dc9-f9847d5439f1 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86292025-01-16T23:38:36.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bb3b9018-de0d-4767-a168-aea6315168db roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86302025-01-16T23:38:36.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bb3b9018-de0d-4767-a168-aea6315168db resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86312025-01-16T23:38:36.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = bb3b9018-de0d-4767-a168-aea6315168db response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86322025-01-16T23:38:37.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
86332025-01-16T23:38:37.003ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
86342025-01-16T23:38:37.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86352025-01-16T23:38:37.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86362025-01-16T23:38:37.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86372025-01-16T23:38:37.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86382025-01-16T23:38:37.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86392025-01-16T23:38:37.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86402025-01-16T23:38:37.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86412025-01-16T23:38:37.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86422025-01-16T23:38:37.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86432025-01-16T23:38:37.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86442025-01-16T23:38:37.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86452025-01-16T23:38:37.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
86462025-01-16T23:38:37.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86472025-01-16T23:38:37.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86482025-01-16T23:38:37.027ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
86492025-01-16T23:38:37.027ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.045242ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
86502025-01-16T23:38:37.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86512025-01-16T23:38:37.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86522025-01-16T23:38:37.031ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.556248ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86532025-01-16T23:38:37.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 393daee6-2737-4527-90b3-167011301dd9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86542025-01-16T23:38:37.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 393daee6-2737-4527-90b3-167011301dd9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86552025-01-16T23:38:37.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 393daee6-2737-4527-90b3-167011301dd9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86562025-01-16T23:38:39.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 92194350-051f-48a1-88b1-a3741344e69b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86572025-01-16T23:38:39.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 92194350-051f-48a1-88b1-a3741344e69b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86582025-01-16T23:38:39.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 92194350-051f-48a1-88b1-a3741344e69b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86592025-01-16T23:38:40.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fc983d23-7670-4b6d-9dd8-72d0ece6d9da roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86602025-01-16T23:38:40.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fc983d23-7670-4b6d-9dd8-72d0ece6d9da resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86612025-01-16T23:38:40.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fc983d23-7670-4b6d-9dd8-72d0ece6d9da response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86622025-01-16T23:38:41.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 34589c08-354b-4ec5-b8d4-12f093e8f01a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86632025-01-16T23:38:41.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 34589c08-354b-4ec5-b8d4-12f093e8f01a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86642025-01-16T23:38:41.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 34589c08-354b-4ec5-b8d4-12f093e8f01a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86652025-01-16T23:38:42.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4218fdc9-b9bd-406a-9c28-fa3775e178a9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86662025-01-16T23:38:42.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4218fdc9-b9bd-406a-9c28-fa3775e178a9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86672025-01-16T23:38:42.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4218fdc9-b9bd-406a-9c28-fa3775e178a9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86682025-01-16T23:38:43.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8b248a3a-c3a4-4b1e-9aa8-97f9cb9c88c9 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86692025-01-16T23:38:43.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8b248a3a-c3a4-4b1e-9aa8-97f9cb9c88c9 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86702025-01-16T23:38:43.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8b248a3a-c3a4-4b1e-9aa8-97f9cb9c88c9 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86712025-01-16T23:38:44.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 565b99ab-9f26-4914-963f-f10b81298f7a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86722025-01-16T23:38:44.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 565b99ab-9f26-4914-963f-f10b81298f7a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86732025-01-16T23:38:44.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 565b99ab-9f26-4914-963f-f10b81298f7a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86742025-01-16T23:38:45.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6fc74b09-9d0c-4945-917a-7c670a1f7248 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86752025-01-16T23:38:45.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6fc74b09-9d0c-4945-917a-7c670a1f7248 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86762025-01-16T23:38:45.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2609 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6fc74b09-9d0c-4945-917a-7c670a1f7248 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86772025-01-16T23:38:45.734ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 614 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = d6471db7-5f2d-457c-af75-acde3b024fbc response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
86782025-01-16T23:38:46.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8a0fe160-49f9-4dbf-bed7-d2e76cbde735 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86792025-01-16T23:38:46.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8a0fe160-49f9-4dbf-bed7-d2e76cbde735 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86802025-01-16T23:38:46.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8a0fe160-49f9-4dbf-bed7-d2e76cbde735 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
86812025-01-16T23:38:47.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
86822025-01-16T23:38:47.004ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
86832025-01-16T23:38:47.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86842025-01-16T23:38:47.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86852025-01-16T23:38:47.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86862025-01-16T23:38:47.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86872025-01-16T23:38:47.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86882025-01-16T23:38:47.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86892025-01-16T23:38:47.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86902025-01-16T23:38:47.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86912025-01-16T23:38:47.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86922025-01-16T23:38:47.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86932025-01-16T23:38:47.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86942025-01-16T23:38:47.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86952025-01-16T23:38:47.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86962025-01-16T23:38:47.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
86972025-01-16T23:38:47.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86982025-01-16T23:38:47.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86992025-01-16T23:38:47.023ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
87002025-01-16T23:38:47.023ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.998954ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
87012025-01-16T23:38:47.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.503354ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87022025-01-16T23:38:47.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f8d77e64-8b7f-4af2-8d12-3ac12c9ee46f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87032025-01-16T23:38:47.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f8d77e64-8b7f-4af2-8d12-3ac12c9ee46f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87042025-01-16T23:38:47.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f8d77e64-8b7f-4af2-8d12-3ac12c9ee46f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87052025-01-16T23:38:48.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a76cfebb-9738-4c4c-a17d-beaec4e1b169 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87062025-01-16T23:38:48.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a76cfebb-9738-4c4c-a17d-beaec4e1b169 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87072025-01-16T23:38:48.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = a76cfebb-9738-4c4c-a17d-beaec4e1b169 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87082025-01-16T23:38:49.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0b44a5cc-52bd-4223-b1dd-41fa80a7e1d2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87092025-01-16T23:38:49.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0b44a5cc-52bd-4223-b1dd-41fa80a7e1d2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87102025-01-16T23:38:49.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0b44a5cc-52bd-4223-b1dd-41fa80a7e1d2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87112025-01-16T23:38:50.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 65a03fd0-dd47-486d-921c-6242443f2865 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87122025-01-16T23:38:50.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 65a03fd0-dd47-486d-921c-6242443f2865 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87132025-01-16T23:38:50.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2943 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 65a03fd0-dd47-486d-921c-6242443f2865 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87142025-01-16T23:38:50.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 433fca14-3e18-48af-977e-f503fc3c6171 roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
87152025-01-16T23:38:50.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 433fca14-3e18-48af-977e-f503fc3c6171 resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
87162025-01-16T23:38:50.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 433fca14-3e18-48af-977e-f503fc3c6171 response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
87172025-01-16T23:38:50.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 9f758b8d-a1ef-48e0-af72-4ef3727ec99a roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
87182025-01-16T23:38:50.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 9f758b8d-a1ef-48e0-af72-4ef3727ec99a resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
87192025-01-16T23:38:50.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 9f758b8d-a1ef-48e0-af72-4ef3727ec99a response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
87202025-01-16T23:38:51.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 26c363ce-c376-4216-98de-6e89d523065f roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87212025-01-16T23:38:51.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 26c363ce-c376-4216-98de-6e89d523065f resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87222025-01-16T23:38:51.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 26c363ce-c376-4216-98de-6e89d523065f response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87232025-01-16T23:38:52.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4c695830-cf8e-4c28-a905-ab590055469a roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87242025-01-16T23:38:52.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4c695830-cf8e-4c28-a905-ab590055469a resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87252025-01-16T23:38:52.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4c695830-cf8e-4c28-a905-ab590055469a response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87262025-01-16T23:38:53.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2b1d9511-7443-476b-93eb-0aed77e53288 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87272025-01-16T23:38:53.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2b1d9511-7443-476b-93eb-0aed77e53288 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87282025-01-16T23:38:53.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2b1d9511-7443-476b-93eb-0aed77e53288 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87292025-01-16T23:38:54.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 33714297-81cd-4ce0-89bd-038af6691493 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87302025-01-16T23:38:54.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 33714297-81cd-4ce0-89bd-038af6691493 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87312025-01-16T23:38:54.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 33714297-81cd-4ce0-89bd-038af6691493 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87322025-01-16T23:38:55.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6d7c4d2d-c1b1-4d62-9868-4db8296d9bbc roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87332025-01-16T23:38:55.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6d7c4d2d-c1b1-4d62-9868-4db8296d9bbc resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87342025-01-16T23:38:55.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6d7c4d2d-c1b1-4d62-9868-4db8296d9bbc response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87352025-01-16T23:38:55.734ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 593 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 02e3ae40-b4f8-4408-bd44-df1028c5f2d7 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
87362025-01-16T23:38:56.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 34b0d8d0-1c80-409e-bfbb-48e5ee938b66 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87372025-01-16T23:38:56.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 34b0d8d0-1c80-409e-bfbb-48e5ee938b66 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87382025-01-16T23:38:56.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 34b0d8d0-1c80-409e-bfbb-48e5ee938b66 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
87392025-01-16T23:38:57.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
87402025-01-16T23:38:57.003ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 30 reason = Timeout
87412025-01-16T23:38:57.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87422025-01-16T23:38:57.003ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
87432025-01-16T23:38:57.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
87442025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87452025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
87462025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
87472025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87482025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
87492025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87502025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
87512025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
87522025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87532025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87542025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
87552025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
87562025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87572025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87582025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
87592025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87602025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
87612025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87622025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87632025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
87642025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87652025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
87662025-01-16T23:38:57.004ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87672025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87682025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
87692025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87702025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87712025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87722025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87732025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87742025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87752025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87762025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
87772025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87782025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87792025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87802025-01-16T23:38:57.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87812025-01-16T23:38:57.005ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
87822025-01-16T23:38:57.005ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87832025-01-16T23:38:57.005ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
87842025-01-16T23:38:57.005ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87852025-01-16T23:38:57.005ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
87862025-01-16T23:38:57.005ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87872025-01-16T23:38:57.005ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
87882025-01-16T23:38:57.005ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87892025-01-16T23:38:57.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
87902025-01-16T23:38:57.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
87912025-01-16T23:38:57.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87922025-01-16T23:38:57.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87932025-01-16T23:38:57.006ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87942025-01-16T23:38:57.007ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87952025-01-16T23:38:57.008ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.035437ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
87962025-01-16T23:38:57.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
87972025-01-16T23:38:57.008ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
87982025-01-16T23:38:57.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
87992025-01-16T23:38:57.009ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1845, tv_nsec: 321858695 } })
88002025-01-16T23:38:57.009ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
88012025-01-16T23:38:57.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
88022025-01-16T23:38:57.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88032025-01-16T23:38:57.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88042025-01-16T23:38:57.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88052025-01-16T23:38:57.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88062025-01-16T23:38:57.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88072025-01-16T23:38:57.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88082025-01-16T23:38:57.012ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88092025-01-16T23:38:57.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88102025-01-16T23:38:57.012ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1845, tv_nsec: 325581867 } })
88112025-01-16T23:38:57.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
88122025-01-16T23:38:57.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88132025-01-16T23:38:57.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88142025-01-16T23:38:57.013ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
88152025-01-16T23:38:57.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88162025-01-16T23:38:57.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88172025-01-16T23:38:57.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
88182025-01-16T23:38:57.016ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88192025-01-16T23:38:57.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88202025-01-16T23:38:57.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88212025-01-16T23:38:57.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88222025-01-16T23:38:57.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88232025-01-16T23:38:57.017ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88242025-01-16T23:38:57.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88252025-01-16T23:38:57.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88262025-01-16T23:38:57.018ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.463039ms iteration = 30 status = {"errors":[],"finish_invoked_ok":[]}
88272025-01-16T23:38:57.020ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88282025-01-16T23:38:57.021ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88292025-01-16T23:38:57.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88302025-01-16T23:38:57.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88312025-01-16T23:38:57.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88322025-01-16T23:38:57.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88332025-01-16T23:38:57.022ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1845, tv_nsec: 335317864 } })
88342025-01-16T23:38:57.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88352025-01-16T23:38:57.022ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
88362025-01-16T23:38:57.023ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88372025-01-16T23:38:57.024ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88382025-01-16T23:38:57.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88392025-01-16T23:38:57.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88402025-01-16T23:38:57.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88412025-01-16T23:38:57.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88422025-01-16T23:38:57.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88432025-01-16T23:38:57.037ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88442025-01-16T23:38:57.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88452025-01-16T23:38:57.040ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88462025-01-16T23:38:57.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88472025-01-16T23:38:57.049ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88482025-01-16T23:38:57.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88492025-01-16T23:38:57.051ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88502025-01-16T23:38:57.051ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
88512025-01-16T23:38:57.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88522025-01-16T23:38:57.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88532025-01-16T23:38:57.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88542025-01-16T23:38:57.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.299848ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
88552025-01-16T23:38:57.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
88562025-01-16T23:38:57.055ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88572025-01-16T23:38:57.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88582025-01-16T23:38:57.057ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 53.052169ms iteration = 30 status = 0
88592025-01-16T23:38:57.057ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88602025-01-16T23:38:57.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88612025-01-16T23:38:57.058ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88622025-01-16T23:38:57.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 55.132989ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88632025-01-16T23:38:57.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88642025-01-16T23:38:57.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88652025-01-16T23:38:57.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88662025-01-16T23:38:57.059ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88672025-01-16T23:38:57.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88682025-01-16T23:38:57.064ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
88692025-01-16T23:38:57.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88702025-01-16T23:38:57.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
88712025-01-16T23:38:57.066ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88722025-01-16T23:38:57.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
88732025-01-16T23:38:57.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88742025-01-16T23:38:57.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88752025-01-16T23:38:57.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
88762025-01-16T23:38:57.068ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
88772025-01-16T23:38:57.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
88782025-01-16T23:38:57.070ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
88792025-01-16T23:38:57.070ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 66.759113ms iteration = 30 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
88802025-01-16T23:38:57.073ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
88812025-01-16T23:38:57.073ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.436144ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
88822025-01-16T23:38:57.080ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
88832025-01-16T23:38:57.080ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.150312ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
88842025-01-16T23:38:57.081ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.007258ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88852025-01-16T23:38:57.083ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88862025-01-16T23:38:57.083ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
88872025-01-16T23:38:57.083ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88882025-01-16T23:38:57.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88892025-01-16T23:38:57.085ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88902025-01-16T23:38:57.085ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
88912025-01-16T23:38:57.085ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 81.365192ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
88922025-01-16T23:38:57.089ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
88932025-01-16T23:38:57.089ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88942025-01-16T23:38:57.089ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5cacfffb-ab8f-4c4a-9065-09f262669944", "content-length": "26", "date": "Thu, 16 Jan 2025 23:38:56 GMT"} })
88952025-01-16T23:38:57.089ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88962025-01-16T23:38:57.091ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88972025-01-16T23:38:57.092ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 87.160245ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88982025-01-16T23:38:57.096ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88992025-01-16T23:38:57.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89002025-01-16T23:38:57.098ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 93.381714ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
89012025-01-16T23:38:57.102ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
89022025-01-16T23:38:57.102ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89032025-01-16T23:38:57.102ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a66ebea7-acdc-440f-bde2-f842fb17b6d1", "content-length": "26", "date": "Thu, 16 Jan 2025 23:38:56 GMT"} })
89042025-01-16T23:38:57.102ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89052025-01-16T23:38:57.104ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89062025-01-16T23:38:57.112ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
89072025-01-16T23:38:57.112ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89082025-01-16T23:38:57.112ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "845b5caa-be53-423b-af9a-a534de392f80", "content-length": "26", "date": "Thu, 16 Jan 2025 23:38:56 GMT"} })
89092025-01-16T23:38:57.112ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89102025-01-16T23:38:57.114ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
89112025-01-16T23:38:57.129ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89122025-01-16T23:38:57.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89132025-01-16T23:38:57.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89142025-01-16T23:38:57.133ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89152025-01-16T23:38:57.133ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89162025-01-16T23:38:57.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89172025-01-16T23:38:57.134ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89182025-01-16T23:38:57.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89192025-01-16T23:38:57.136ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89202025-01-16T23:38:57.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89212025-01-16T23:38:57.136ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 132.855462ms iteration = 33 status = {"physical_disks_added":0}
89222025-01-16T23:38:57.207ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
89232025-01-16T23:38:57.207ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "794875eb-7d5c-4813-969f-19b993f15209", "content-length": "2", "date": "Thu, 16 Jan 2025 23:38:57 GMT"} })
89242025-01-16T23:38:57.208ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89252025-01-16T23:38:57.208ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
89262025-01-16T23:38:57.209ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89272025-01-16T23:38:57.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89282025-01-16T23:38:57.210ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 206.923854ms iteration = 30 status = null
89292025-01-16T23:38:57.220ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 216.348015ms iteration = 30 status = {}
89302025-01-16T23:38:57.233ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d80cf28-65bb-4a25-8b22-7b0b22656b11", "content-length": "372", "date": "Thu, 16 Jan 2025 23:38:57 GMT"} })
89312025-01-16T23:38:57.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89322025-01-16T23:38:57.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89332025-01-16T23:38:57.237ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
89342025-01-16T23:38:57.237ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0f570ad-8cd5-4902-a352-f7004d2943b2", "content-length": "691", "date": "Thu, 16 Jan 2025 23:38:57 GMT"} })
89352025-01-16T23:38:57.237ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
89362025-01-16T23:38:57.237ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
89372025-01-16T23:38:57.237ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
89382025-01-16T23:38:57.239ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 235.279249ms iteration = 31 status = {}
89392025-01-16T23:38:57.249ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
89402025-01-16T23:38:57.249ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
89412025-01-16T23:38:57.249ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9c76920c-d8b9-446e-bc87-b54d4b84b668", "date": "Thu, 16 Jan 2025 23:38:57 GMT"} })
89422025-01-16T23:38:57.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89432025-01-16T23:38:57.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89442025-01-16T23:38:57.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89452025-01-16T23:38:57.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89462025-01-16T23:38:57.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89472025-01-16T23:38:57.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89482025-01-16T23:38:57.260ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
89492025-01-16T23:38:57.260ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89502025-01-16T23:38:57.260ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dec637ba-1f17-4572-90e2-0e01105f5e5b", "date": "Thu, 16 Jan 2025 23:38:57 GMT"} })
89512025-01-16T23:38:57.262ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 258.410522ms iteration = 31 status = {}
89522025-01-16T23:38:57.291ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89532025-01-16T23:38:57.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89542025-01-16T23:38:57.293ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
89552025-01-16T23:38:57.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89562025-01-16T23:38:57.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89572025-01-16T23:38:57.302ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
89582025-01-16T23:38:57.303ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "44668508-146e-45f9-91d7-69511046e274", "content-length": "134", "date": "Thu, 16 Jan 2025 23:38:57 GMT"} })
89592025-01-16T23:38:57.303ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
89602025-01-16T23:38:57.303ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
89612025-01-16T23:38:57.303ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
89622025-01-16T23:38:57.303ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
89632025-01-16T23:38:57.303ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89642025-01-16T23:38:57.303ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89652025-01-16T23:38:57.303ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89662025-01-16T23:38:57.303ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89672025-01-16T23:38:57.303ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89682025-01-16T23:38:57.303ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89692025-01-16T23:38:57.303ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
89702025-01-16T23:38:57.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89712025-01-16T23:38:57.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89722025-01-16T23:38:57.305ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
89732025-01-16T23:38:57.305ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b2c9e61-8e5a-4fb0-9aeb-a63797212ec0", "content-length": "2", "date": "Thu, 16 Jan 2025 23:38:57 GMT"} })
89742025-01-16T23:38:57.305ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
89752025-01-16T23:38:57.305ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "aace4784-e612-40c4-9725-65ff584de5c2", "content-length": "52", "date": "Thu, 16 Jan 2025 23:38:57 GMT"} })
89762025-01-16T23:38:57.305ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
89772025-01-16T23:38:57.305ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
89782025-01-16T23:38:57.399ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "caf02640-6944-4193-9cd5-c0b1a304f99d", "date": "Thu, 16 Jan 2025 23:38:57 GMT"} })
89792025-01-16T23:38:57.399ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
89802025-01-16T23:38:57.399ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
89812025-01-16T23:38:57.399ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9af84af-420c-441c-bac1-d67d7fb64757", "content-length": "682", "date": "Thu, 16 Jan 2025 23:38:57 GMT"} })
89822025-01-16T23:38:57.399ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89832025-01-16T23:38:57.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89842025-01-16T23:38:57.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89852025-01-16T23:38:57.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89862025-01-16T23:38:57.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89872025-01-16T23:38:57.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89882025-01-16T23:38:57.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ce47402e-b7ec-4200-8529-f62880901a28 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
89892025-01-16T23:38:57.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ce47402e-b7ec-4200-8529-f62880901a28 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
89902025-01-16T23:38:57.408ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89912025-01-16T23:38:57.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ce47402e-b7ec-4200-8529-f62880901a28 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
89922025-01-16T23:38:57.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89932025-01-16T23:38:57.415ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 411.928482ms iteration = 30 status = {}
89942025-01-16T23:38:58.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 776c563c-3330-442b-a900-660a12c7e802 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
89952025-01-16T23:38:58.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 776c563c-3330-442b-a900-660a12c7e802 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
89962025-01-16T23:38:58.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 776c563c-3330-442b-a900-660a12c7e802 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
89972025-01-16T23:38:59.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 90656425-bed7-416c-a726-7f6004ef2500 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
89982025-01-16T23:38:59.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 90656425-bed7-416c-a726-7f6004ef2500 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
89992025-01-16T23:38:59.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 90656425-bed7-416c-a726-7f6004ef2500 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90002025-01-16T23:39:00.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fec9fa0b-420b-4dfe-98a2-3182de3aff5e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90012025-01-16T23:39:00.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fec9fa0b-420b-4dfe-98a2-3182de3aff5e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90022025-01-16T23:39:00.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = fec9fa0b-420b-4dfe-98a2-3182de3aff5e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90032025-01-16T23:39:01.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9609855f-12f1-4742-89db-2acdd02d542c roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90042025-01-16T23:39:01.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9609855f-12f1-4742-89db-2acdd02d542c resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90052025-01-16T23:39:01.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9609855f-12f1-4742-89db-2acdd02d542c response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90062025-01-16T23:39:02.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 88a4573e-f5ab-4231-92f9-af664ee02c84 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90072025-01-16T23:39:02.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 88a4573e-f5ab-4231-92f9-af664ee02c84 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90082025-01-16T23:39:02.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 88a4573e-f5ab-4231-92f9-af664ee02c84 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90092025-01-16T23:39:03.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3018b54a-a361-4a6b-8dab-30f78302f7b2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90102025-01-16T23:39:03.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3018b54a-a361-4a6b-8dab-30f78302f7b2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90112025-01-16T23:39:03.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 3018b54a-a361-4a6b-8dab-30f78302f7b2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90122025-01-16T23:39:04.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = df05a486-28c3-4ca5-9f1a-eb8be6efe712 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90132025-01-16T23:39:04.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = df05a486-28c3-4ca5-9f1a-eb8be6efe712 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90142025-01-16T23:39:04.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = df05a486-28c3-4ca5-9f1a-eb8be6efe712 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90152025-01-16T23:39:05.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5b6ff99e-be23-49e5-b484-86bc31f9c93e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90162025-01-16T23:39:05.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5b6ff99e-be23-49e5-b484-86bc31f9c93e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90172025-01-16T23:39:05.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5b6ff99e-be23-49e5-b484-86bc31f9c93e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90182025-01-16T23:39:05.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 77bc9c52-38b0-4b01-9e5b-bec464edd91c roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
90192025-01-16T23:39:05.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 77bc9c52-38b0-4b01-9e5b-bec464edd91c resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
90202025-01-16T23:39:05.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 77bc9c52-38b0-4b01-9e5b-bec464edd91c response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
90212025-01-16T23:39:05.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 718f4850-9d7b-4aa9-be1e-3fa045576f9b roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
90222025-01-16T23:39:05.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 718f4850-9d7b-4aa9-be1e-3fa045576f9b resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
90232025-01-16T23:39:05.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 718f4850-9d7b-4aa9-be1e-3fa045576f9b response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
90242025-01-16T23:39:05.735ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 523 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 5f50f1c2-fb8e-4416-a783-025b9ed93f62 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
90252025-01-16T23:39:06.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 21dfe799-70ec-43bd-a6ee-3c55d3ed6e34 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90262025-01-16T23:39:06.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 21dfe799-70ec-43bd-a6ee-3c55d3ed6e34 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90272025-01-16T23:39:06.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 21dfe799-70ec-43bd-a6ee-3c55d3ed6e34 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90282025-01-16T23:39:07.004ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
90292025-01-16T23:39:07.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90302025-01-16T23:39:07.004ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
90312025-01-16T23:39:07.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90322025-01-16T23:39:07.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90332025-01-16T23:39:07.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90342025-01-16T23:39:07.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90352025-01-16T23:39:07.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90362025-01-16T23:39:07.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90372025-01-16T23:39:07.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.6157ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90382025-01-16T23:39:07.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90392025-01-16T23:39:07.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90402025-01-16T23:39:07.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90412025-01-16T23:39:07.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90422025-01-16T23:39:07.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90432025-01-16T23:39:07.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90442025-01-16T23:39:07.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
90452025-01-16T23:39:07.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90462025-01-16T23:39:07.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90472025-01-16T23:39:07.024ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
90482025-01-16T23:39:07.024ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.200947ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
90492025-01-16T23:39:07.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ea7d5b8c-934a-401a-81d2-684957f0d842 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90502025-01-16T23:39:07.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ea7d5b8c-934a-401a-81d2-684957f0d842 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90512025-01-16T23:39:07.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ea7d5b8c-934a-401a-81d2-684957f0d842 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90522025-01-16T23:39:08.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f912c363-c646-416d-b64f-b89cb4ab9650 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90532025-01-16T23:39:08.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f912c363-c646-416d-b64f-b89cb4ab9650 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90542025-01-16T23:39:08.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2793 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f912c363-c646-416d-b64f-b89cb4ab9650 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90552025-01-16T23:39:09.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8466f6d1-6a3c-402a-b718-0cb660dd8a94 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90562025-01-16T23:39:09.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8466f6d1-6a3c-402a-b718-0cb660dd8a94 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90572025-01-16T23:39:09.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 8466f6d1-6a3c-402a-b718-0cb660dd8a94 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90582025-01-16T23:39:10.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 59014da2-fd19-433e-9207-1982861ec82d roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90592025-01-16T23:39:10.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 59014da2-fd19-433e-9207-1982861ec82d resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90602025-01-16T23:39:10.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 59014da2-fd19-433e-9207-1982861ec82d response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90612025-01-16T23:39:11.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cd6a2253-d678-4acc-9505-c82433189ac6 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90622025-01-16T23:39:11.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cd6a2253-d678-4acc-9505-c82433189ac6 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90632025-01-16T23:39:11.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = cd6a2253-d678-4acc-9505-c82433189ac6 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90642025-01-16T23:39:12.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5641f098-4d1b-424f-922b-e2bccdf72814 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90652025-01-16T23:39:12.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5641f098-4d1b-424f-922b-e2bccdf72814 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90662025-01-16T23:39:12.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5641f098-4d1b-424f-922b-e2bccdf72814 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90672025-01-16T23:39:13.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6e7b3917-5c35-4fce-a550-18d404fcb1ae roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90682025-01-16T23:39:13.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6e7b3917-5c35-4fce-a550-18d404fcb1ae resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90692025-01-16T23:39:13.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6e7b3917-5c35-4fce-a550-18d404fcb1ae response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90702025-01-16T23:39:14.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c1c02d4a-6dd8-4f3c-8844-acc93df66c35 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90712025-01-16T23:39:14.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c1c02d4a-6dd8-4f3c-8844-acc93df66c35 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90722025-01-16T23:39:14.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c1c02d4a-6dd8-4f3c-8844-acc93df66c35 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90732025-01-16T23:39:15.735ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 632 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 9b50cb09-6449-4c55-8b47-7362fbb0d89b response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
90742025-01-16T23:39:15.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d48184cb-c47d-43b4-ae92-be9b23869ba1 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90752025-01-16T23:39:15.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d48184cb-c47d-43b4-ae92-be9b23869ba1 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90762025-01-16T23:39:15.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d48184cb-c47d-43b4-ae92-be9b23869ba1 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90772025-01-16T23:39:16.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f47de51c-fde2-4069-a5ca-dc6470cf393d roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90782025-01-16T23:39:16.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f47de51c-fde2-4069-a5ca-dc6470cf393d resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90792025-01-16T23:39:16.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f47de51c-fde2-4069-a5ca-dc6470cf393d response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
90802025-01-16T23:39:17.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
90812025-01-16T23:39:17.003ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
90822025-01-16T23:39:17.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90832025-01-16T23:39:17.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90842025-01-16T23:39:17.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90852025-01-16T23:39:17.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90862025-01-16T23:39:17.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90872025-01-16T23:39:17.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90882025-01-16T23:39:17.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90892025-01-16T23:39:17.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90902025-01-16T23:39:17.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90912025-01-16T23:39:17.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90922025-01-16T23:39:17.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90932025-01-16T23:39:17.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
90942025-01-16T23:39:17.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90952025-01-16T23:39:17.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90962025-01-16T23:39:17.024ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
90972025-01-16T23:39:17.024ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.477514ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
90982025-01-16T23:39:17.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90992025-01-16T23:39:17.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91002025-01-16T23:39:17.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.487046ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91012025-01-16T23:39:17.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f76bbc49-7a96-487b-a859-78c005878b98 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91022025-01-16T23:39:17.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f76bbc49-7a96-487b-a859-78c005878b98 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91032025-01-16T23:39:17.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f76bbc49-7a96-487b-a859-78c005878b98 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91042025-01-16T23:39:18.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d0250650-67fb-467a-8e0d-8b9802eb94c2 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91052025-01-16T23:39:18.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d0250650-67fb-467a-8e0d-8b9802eb94c2 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91062025-01-16T23:39:18.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d0250650-67fb-467a-8e0d-8b9802eb94c2 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91072025-01-16T23:39:19.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9956fa7b-b663-437f-b7f2-c573ae4491ce roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91082025-01-16T23:39:19.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9956fa7b-b663-437f-b7f2-c573ae4491ce resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91092025-01-16T23:39:19.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 9956fa7b-b663-437f-b7f2-c573ae4491ce response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91102025-01-16T23:39:20.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 1f697d7f-f5b2-42a0-95f1-a9a01127f62f roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
91112025-01-16T23:39:20.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 1f697d7f-f5b2-42a0-95f1-a9a01127f62f resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
91122025-01-16T23:39:20.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 1f697d7f-f5b2-42a0-95f1-a9a01127f62f response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?sort_by=id_ascending
91132025-01-16T23:39:20.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 7ca2cc1c-37a7-4a06-bf04-0f2639c38af2 roles = RoleSet { roles: {} } uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
91142025-01-16T23:39:20.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 7ca2cc1c-37a7-4a06-bf04-0f2639c38af2 resource = Database result = Ok(()) uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
91152025-01-16T23:39:20.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47848 req_id = 7ca2cc1c-37a7-4a06-bf04-0f2639c38af2 response_code = 200 uri = /metrics/collectors/0a365f9e-6c70-4a27-ba2b-6123ad53013e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTYxNDY5ZS1lNDRjLTRhOGYtYTRjZi1kZTg2N2RiZGI4NTgifX0%3D
91162025-01-16T23:39:20.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1d034699-aa37-44ce-83d9-7d29687e4bd4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91172025-01-16T23:39:20.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1d034699-aa37-44ce-83d9-7d29687e4bd4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91182025-01-16T23:39:20.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 1d034699-aa37-44ce-83d9-7d29687e4bd4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91192025-01-16T23:39:21.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e9c9a625-7400-4000-b83e-75bd925eb60b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91202025-01-16T23:39:21.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e9c9a625-7400-4000-b83e-75bd925eb60b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91212025-01-16T23:39:21.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1784 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e9c9a625-7400-4000-b83e-75bd925eb60b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91222025-01-16T23:39:22.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4bde7d02-6a57-47d1-b0c6-007249cea9b3 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91232025-01-16T23:39:22.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4bde7d02-6a57-47d1-b0c6-007249cea9b3 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91242025-01-16T23:39:22.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 4bde7d02-6a57-47d1-b0c6-007249cea9b3 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91252025-01-16T23:39:23.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0db87963-f398-4d72-b4e5-11bc7b83c0f4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91262025-01-16T23:39:23.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0db87963-f398-4d72-b4e5-11bc7b83c0f4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91272025-01-16T23:39:23.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0db87963-f398-4d72-b4e5-11bc7b83c0f4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91282025-01-16T23:39:25.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 75c797f7-187f-4eaf-8cc3-5c496c753384 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91292025-01-16T23:39:25.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 75c797f7-187f-4eaf-8cc3-5c496c753384 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91302025-01-16T23:39:25.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 75c797f7-187f-4eaf-8cc3-5c496c753384 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91312025-01-16T23:39:25.735ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 617 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = c8a99de1-963c-4820-bfe9-afdacc459615 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
91322025-01-16T23:39:26.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2b112bac-3601-45e1-b924-76b42cd8a4ba roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91332025-01-16T23:39:26.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2b112bac-3601-45e1-b924-76b42cd8a4ba resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91342025-01-16T23:39:26.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 2b112bac-3601-45e1-b924-76b42cd8a4ba response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
91352025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
91362025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91372025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
91382025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
91392025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
91402025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91412025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
91422025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
91432025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91442025-01-16T23:39:27.004ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
91452025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
91462025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
91472025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 31 reason = Timeout
91482025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
91492025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
91502025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91512025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
91522025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
91532025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
91542025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91552025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91562025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
91572025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
91582025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
91592025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91602025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
91612025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91622025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
91632025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
91642025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
91652025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
91662025-01-16T23:39:27.004ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca
91672025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
91682025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
91692025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.5\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca"}
91702025-01-16T23:39:27.004ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-16 23:29:27.004433960 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
91712025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
91722025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
91732025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
91742025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
91752025-01-16T23:39:27.004ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
91762025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91772025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91782025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
91792025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
91802025-01-16T23:39:27.004ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
91812025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91822025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
91832025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
91842025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91852025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
91862025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91872025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
91882025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
91892025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
91902025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91912025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
91922025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91932025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
91942025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
91952025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
91962025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
91972025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
91982025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
91992025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
92002025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
92012025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
92022025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
92032025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92042025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92052025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92062025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
92072025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92082025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92092025-01-16T23:39:27.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
92102025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92112025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92122025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92132025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92142025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92152025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92162025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92172025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92182025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
92192025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
92202025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92212025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92222025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92232025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92242025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92252025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92262025-01-16T23:39:27.005ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5c1ab32c-50b8-4564-bf29-e388b915cbdb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd10c057-8c9f-4db2-98b5-bcf5e0d536ba.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd7a4ec0-c746-4aff-9239-7c8992ff75d9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1875, tv_nsec: 317772267 } })
92272025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92282025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
92292025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92302025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92312025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92322025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
92332025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92342025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92352025-01-16T23:39:27.005ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dc5f3810-93b6-44f1-815c-44411abf99ad.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f4635fcc-61fc-4ff9-8203-b560522a972b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1875, tv_nsec: 317882369 } })
92362025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92372025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92382025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92392025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92402025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92412025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
92422025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.229664ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
92432025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
92442025-01-16T23:39:27.005ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.398637ms iteration = 16 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
92452025-01-16T23:39:27.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92462025-01-16T23:39:27.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92472025-01-16T23:39:27.007ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.435536ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92482025-01-16T23:39:27.008ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92492025-01-16T23:39:27.008ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1875, tv_nsec: 321228513 } })
92502025-01-16T23:39:27.008ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
92512025-01-16T23:39:27.009ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92522025-01-16T23:39:27.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
92532025-01-16T23:39:27.010ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
92542025-01-16T23:39:27.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
92552025-01-16T23:39:27.011ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
92562025-01-16T23:39:27.011ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92572025-01-16T23:39:27.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92582025-01-16T23:39:27.012ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92592025-01-16T23:39:27.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92602025-01-16T23:39:27.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
92612025-01-16T23:39:27.015ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92622025-01-16T23:39:27.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92632025-01-16T23:39:27.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
92642025-01-16T23:39:27.020ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92652025-01-16T23:39:27.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92662025-01-16T23:39:27.021ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92672025-01-16T23:39:27.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92682025-01-16T23:39:27.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92692025-01-16T23:39:27.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92702025-01-16T23:39:27.022ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-16 23:29:27.004433960 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
92712025-01-16T23:39:27.022ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.414563ms iteration = 16 status = {"expiration":"2025-01-16T23:29:27.004433960Z","pruned":[]}
92722025-01-16T23:39:27.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92732025-01-16T23:39:27.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92742025-01-16T23:39:27.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92752025-01-16T23:39:27.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92762025-01-16T23:39:27.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92772025-01-16T23:39:27.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92782025-01-16T23:39:27.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92792025-01-16T23:39:27.033ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92802025-01-16T23:39:27.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92812025-01-16T23:39:27.035ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1875, tv_nsec: 347602080 } })
92822025-01-16T23:39:27.035ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
92832025-01-16T23:39:27.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
92842025-01-16T23:39:27.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92852025-01-16T23:39:27.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92862025-01-16T23:39:27.036ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92872025-01-16T23:39:27.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92882025-01-16T23:39:27.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92892025-01-16T23:39:27.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
92902025-01-16T23:39:27.036ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92912025-01-16T23:39:27.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92922025-01-16T23:39:27.040ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 36.196945ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
92932025-01-16T23:39:27.041ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92942025-01-16T23:39:27.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
92952025-01-16T23:39:27.044ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92962025-01-16T23:39:27.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92972025-01-16T23:39:27.045ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92982025-01-16T23:39:27.047ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92992025-01-16T23:39:27.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93002025-01-16T23:39:27.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
93012025-01-16T23:39:27.048ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93022025-01-16T23:39:27.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93032025-01-16T23:39:27.048ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93042025-01-16T23:39:27.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6a67d519-454a-42c4-8c12-f223e8b1fd98 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
93052025-01-16T23:39:27.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6a67d519-454a-42c4-8c12-f223e8b1fd98 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
93062025-01-16T23:39:27.049ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93072025-01-16T23:39:27.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
93082025-01-16T23:39:27.051ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93092025-01-16T23:39:27.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93102025-01-16T23:39:27.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
93112025-01-16T23:39:27.052ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
93122025-01-16T23:39:27.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
93132025-01-16T23:39:27.053ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93142025-01-16T23:39:27.054ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93152025-01-16T23:39:27.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93162025-01-16T23:39:27.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93172025-01-16T23:39:27.055ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93182025-01-16T23:39:27.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93192025-01-16T23:39:27.056ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93202025-01-16T23:39:27.056ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93212025-01-16T23:39:27.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93222025-01-16T23:39:27.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93232025-01-16T23:39:27.057ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93242025-01-16T23:39:27.057ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93252025-01-16T23:39:27.057ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93262025-01-16T23:39:27.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93272025-01-16T23:39:27.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93282025-01-16T23:39:27.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93292025-01-16T23:39:27.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93302025-01-16T23:39:27.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
93312025-01-16T23:39:27.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93322025-01-16T23:39:27.063ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-198593b5-c3c6-4ef5-879a-52095a2ef511.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1875, tv_nsec: 376343312 } })
93332025-01-16T23:39:27.064ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
93342025-01-16T23:39:27.064ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93352025-01-16T23:39:27.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93362025-01-16T23:39:27.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93372025-01-16T23:39:27.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93382025-01-16T23:39:27.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93392025-01-16T23:39:27.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6a67d519-454a-42c4-8c12-f223e8b1fd98 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
93402025-01-16T23:39:27.067ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.45304ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
93412025-01-16T23:39:27.068ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93422025-01-16T23:39:27.069ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93432025-01-16T23:39:27.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93442025-01-16T23:39:27.070ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93452025-01-16T23:39:27.070ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93462025-01-16T23:39:27.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93472025-01-16T23:39:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93482025-01-16T23:39:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93492025-01-16T23:39:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93502025-01-16T23:39:27.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
93512025-01-16T23:39:27.073ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93522025-01-16T23:39:27.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93532025-01-16T23:39:27.074ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.105817ms iteration = 31 status = {"errors":[],"finish_invoked_ok":[]}
93542025-01-16T23:39:27.077ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93552025-01-16T23:39:27.078ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93562025-01-16T23:39:27.079ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93572025-01-16T23:39:27.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93582025-01-16T23:39:27.081ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
93592025-01-16T23:39:27.081ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
93602025-01-16T23:39:27.081ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 76.304045ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
93612025-01-16T23:39:27.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
93622025-01-16T23:39:27.081ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93632025-01-16T23:39:27.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93642025-01-16T23:39:27.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
93652025-01-16T23:39:27.085ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
93662025-01-16T23:39:27.085ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
93672025-01-16T23:39:27.085ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 80.869123ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
93682025-01-16T23:39:27.087ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93692025-01-16T23:39:27.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93702025-01-16T23:39:27.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93712025-01-16T23:39:27.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93722025-01-16T23:39:27.093ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93732025-01-16T23:39:27.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93742025-01-16T23:39:27.096ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 91.909566ms iteration = 7 status = {"nsuccess":5}
93752025-01-16T23:39:27.103ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93762025-01-16T23:39:27.103ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 99.188836ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
93772025-01-16T23:39:27.107ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
93782025-01-16T23:39:27.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
93792025-01-16T23:39:27.109ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
93802025-01-16T23:39:27.109ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
93812025-01-16T23:39:27.109ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
93822025-01-16T23:39:27.109ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93832025-01-16T23:39:27.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93842025-01-16T23:39:27.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93852025-01-16T23:39:27.112ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
93862025-01-16T23:39:27.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
93872025-01-16T23:39:27.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93882025-01-16T23:39:27.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93892025-01-16T23:39:27.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93902025-01-16T23:39:27.115ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 111.119025ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93912025-01-16T23:39:27.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
93922025-01-16T23:39:27.117ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93932025-01-16T23:39:27.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93942025-01-16T23:39:27.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
93952025-01-16T23:39:27.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93962025-01-16T23:39:27.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93972025-01-16T23:39:27.124ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93982025-01-16T23:39:27.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93992025-01-16T23:39:27.126ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 122.35095ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
94002025-01-16T23:39:27.128ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
94012025-01-16T23:39:27.128ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
94022025-01-16T23:39:27.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
94032025-01-16T23:39:27.131ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
94042025-01-16T23:39:27.131ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
94052025-01-16T23:39:27.131ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
94062025-01-16T23:39:27.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94072025-01-16T23:39:27.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94082025-01-16T23:39:27.133ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
94092025-01-16T23:39:27.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
94102025-01-16T23:39:27.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94112025-01-16T23:39:27.135ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94122025-01-16T23:39:27.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94132025-01-16T23:39:27.135ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
94142025-01-16T23:39:27.135ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 131.019426ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
94152025-01-16T23:39:27.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94162025-01-16T23:39:27.137ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94172025-01-16T23:39:27.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94182025-01-16T23:39:27.138ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94192025-01-16T23:39:27.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94202025-01-16T23:39:27.139ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94212025-01-16T23:39:27.140ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 136.283337ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
94222025-01-16T23:39:27.141ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 136.621314ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
94232025-01-16T23:39:27.141ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
94242025-01-16T23:39:27.141ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94252025-01-16T23:39:27.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94262025-01-16T23:39:27.142ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94272025-01-16T23:39:27.142ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
94282025-01-16T23:39:27.142ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 138.361678ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
94292025-01-16T23:39:27.146ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
94302025-01-16T23:39:27.147ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94312025-01-16T23:39:27.150ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
94322025-01-16T23:39:27.150ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
94332025-01-16T23:39:27.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
94342025-01-16T23:39:27.156ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
94352025-01-16T23:39:27.156ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94362025-01-16T23:39:27.156ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb324152-f36d-49be-a2c0-0e0ce35db284", "content-length": "26", "date": "Thu, 16 Jan 2025 23:39:27 GMT"} })
94372025-01-16T23:39:27.156ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94382025-01-16T23:39:27.158ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94392025-01-16T23:39:27.162ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
94402025-01-16T23:39:27.162ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 0 version = 2
94412025-01-16T23:39:27.162ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94422025-01-16T23:39:27.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94432025-01-16T23:39:27.164ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94442025-01-16T23:39:27.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94452025-01-16T23:39:27.167ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94462025-01-16T23:39:27.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94472025-01-16T23:39:27.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94482025-01-16T23:39:27.170ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1d666faf-e0f3-47e6-9521-2c5224f5c82c dns_zone_name = oxide.test found_so_far = 1 version = 2
94492025-01-16T23:39:27.170ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
94502025-01-16T23:39:27.170ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-16 23:25:21.695734 UTC dns_group = external generation = 2
94512025-01-16T23:39:27.170ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 165.912336ms iteration = 16 status = {"generation":2}
94522025-01-16T23:39:27.172ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
94532025-01-16T23:39:27.172ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94542025-01-16T23:39:27.172ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c77981ec-394d-44ff-a871-29d8c007828c", "content-length": "26", "date": "Thu, 16 Jan 2025 23:39:27 GMT"} })
94552025-01-16T23:39:27.172ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94562025-01-16T23:39:27.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
94572025-01-16T23:39:27.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94582025-01-16T23:39:27.174ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94592025-01-16T23:39:27.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94602025-01-16T23:39:27.176ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 171.864201ms iteration = 31 status = 0
94612025-01-16T23:39:27.178ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94622025-01-16T23:39:27.179ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
94632025-01-16T23:39:27.179ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 175.560691ms iteration = 31 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
94642025-01-16T23:39:27.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
94652025-01-16T23:39:27.181ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
94662025-01-16T23:39:27.181ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-16T23:24:20.471931Z, time_modified: 2025-01-16T23:24:20.471931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 53828d51-c7a3-4557-b913-6b5f10d267df, db_silo: Silo { identity: SiloIdentity { id: 53828d51-c7a3-4557-b913-6b5f10d267df, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T23:25:21.631636Z, time_modified: 2025-01-16T23:25:21.631636Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180" }] }) }
94672025-01-16T23:39:27.181ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 177.320866ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]}},"default_endpoint":{"silo_id":"53828d51-c7a3-4557-b913-6b5f10d267df","tls_certs":["a4365d8b9afd4ed855bf754b4e3aa2c5adc27081e5ed78a8729dbf95cbd20180"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
94682025-01-16T23:39:27.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
94692025-01-16T23:39:27.183ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
94702025-01-16T23:39:27.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
94712025-01-16T23:39:27.183ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
94722025-01-16T23:39:27.183ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
94732025-01-16T23:39:27.183ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94742025-01-16T23:39:27.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94752025-01-16T23:39:27.184ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
94762025-01-16T23:39:27.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
94772025-01-16T23:39:27.185ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94782025-01-16T23:39:27.186ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94792025-01-16T23:39:27.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94802025-01-16T23:39:27.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94812025-01-16T23:39:27.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94822025-01-16T23:39:27.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
94832025-01-16T23:39:27.188ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
94842025-01-16T23:39:27.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
94852025-01-16T23:39:27.191ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 5f7b2597-7e3e-46de-bb64-35ac03a6ae72 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
94862025-01-16T23:39:27.191ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
94872025-01-16T23:39:27.191ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-16 23:25:20.756297 UTC dns_group = internal generation = 1
94882025-01-16T23:39:27.191ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 187.003261ms iteration = 16 status = {"generation":1}
94892025-01-16T23:39:27.191ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
94902025-01-16T23:39:27.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
94912025-01-16T23:39:27.192ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
94922025-01-16T23:39:27.192ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 187.705225ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
94932025-01-16T23:39:27.192ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94942025-01-16T23:39:27.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94952025-01-16T23:39:27.193ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
94962025-01-16T23:39:27.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
94972025-01-16T23:39:27.194ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94982025-01-16T23:39:27.195ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
94992025-01-16T23:39:27.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95002025-01-16T23:39:27.196ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95012025-01-16T23:39:27.196ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95022025-01-16T23:39:27.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95032025-01-16T23:39:27.196ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95042025-01-16T23:39:27.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95052025-01-16T23:39:27.197ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95062025-01-16T23:39:27.199ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95072025-01-16T23:39:27.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95082025-01-16T23:39:27.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95092025-01-16T23:39:27.213ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 209.341181ms iteration = 34 status = {"physical_disks_added":0}
95102025-01-16T23:39:27.232ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 zone_address = fd00:1122:3344:101::2
95112025-01-16T23:39:27.232ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95122025-01-16T23:39:27.232ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "10c72ff9-9415-43bf-8472-337e307bb106", "content-length": "26", "date": "Thu, 16 Jan 2025 23:39:27 GMT"} })
95132025-01-16T23:39:27.232ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95142025-01-16T23:39:27.234ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 79114303-f678-43f7-aff3-a882c8c99560
95152025-01-16T23:39:27.278ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
95162025-01-16T23:39:27.278ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "18b2739b-1c5e-44d9-ac85-4b35e989c3a4", "date": "Thu, 16 Jan 2025 23:39:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95172025-01-16T23:39:27.278ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95182025-01-16T23:39:27.280ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2e2539a0-6708-441e-ae62-87309a786bf0", "date": "Thu, 16 Jan 2025 23:39:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95192025-01-16T23:39:27.280ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95202025-01-16T23:39:27.282ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95212025-01-16T23:39:27.282ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 278.184063ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
95222025-01-16T23:39:27.304ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
95232025-01-16T23:39:27.304ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "70f91136-213d-42db-b993-2268ceece148", "content-length": "2", "date": "Thu, 16 Jan 2025 23:39:26 GMT"} })
95242025-01-16T23:39:27.306ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95252025-01-16T23:39:27.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95262025-01-16T23:39:27.308ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
95272025-01-16T23:39:27.329ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 324.829298ms iteration = 31 status = {}
95282025-01-16T23:39:27.329ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
95292025-01-16T23:39:27.329ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95302025-01-16T23:39:27.330ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c18f233-f8b9-4cef-bb5e-4f5c070e19da", "content-length": "372", "date": "Thu, 16 Jan 2025 23:39:27 GMT"} })
95312025-01-16T23:39:27.330ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95322025-01-16T23:39:27.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95332025-01-16T23:39:27.331ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95342025-01-16T23:39:27.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95352025-01-16T23:39:27.332ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 328.210823ms iteration = 31 status = null
95362025-01-16T23:39:27.332ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95372025-01-16T23:39:27.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95382025-01-16T23:39:27.334ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95392025-01-16T23:39:27.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
95402025-01-16T23:39:27.337ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95412025-01-16T23:39:27.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95422025-01-16T23:39:27.346ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
95432025-01-16T23:39:27.346ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
95442025-01-16T23:39:27.346ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e13d8b61-a0c7-439b-9569-2b8e697af72c", "date": "Thu, 16 Jan 2025 23:39:27 GMT"} })
95452025-01-16T23:39:27.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95462025-01-16T23:39:27.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95472025-01-16T23:39:27.396ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
95482025-01-16T23:39:27.397ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8e6f341a-8372-43b2-8cb1-4f8a897060e0", "date": "Thu, 16 Jan 2025 23:39:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
95492025-01-16T23:39:27.397ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
95502025-01-16T23:39:27.399ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ce5ad0c2-43ee-4d0d-8c28-b6eb9c8aec16", "date": "Thu, 16 Jan 2025 23:39:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
95512025-01-16T23:39:27.399ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
95522025-01-16T23:39:27.400ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7285f982-7228-4dc1-8d66-f7b93c475603", "date": "Thu, 16 Jan 2025 23:39:27 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
95532025-01-16T23:39:27.400ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
95542025-01-16T23:39:27.402ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
95552025-01-16T23:39:27.403ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 398.545384ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
95562025-01-16T23:39:27.417ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
95572025-01-16T23:39:27.417ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0134d9b5-c55f-4d7e-b81d-cf43c3fba057", "content-length": "691", "date": "Thu, 16 Jan 2025 23:39:27 GMT"} })
95582025-01-16T23:39:27.417ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
95592025-01-16T23:39:27.417ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
95602025-01-16T23:39:27.417ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
95612025-01-16T23:39:27.419ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95622025-01-16T23:39:27.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95632025-01-16T23:39:27.420ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95642025-01-16T23:39:27.420ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 415.849877ms iteration = 32 status = {}
95652025-01-16T23:39:27.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95662025-01-16T23:39:27.421ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95672025-01-16T23:39:27.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95682025-01-16T23:39:27.423ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95692025-01-16T23:39:27.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95702025-01-16T23:39:27.423ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95712025-01-16T23:39:27.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95722025-01-16T23:39:27.426ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95732025-01-16T23:39:27.426ZINFOnexus (BackgroundTasks): VPC route manager sled 198593b5-c3c6-4ef5-879a-52095a2ef511 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95742025-01-16T23:39:27.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95752025-01-16T23:39:27.426ZDEBGnexus (BackgroundTasks): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95762025-01-16T23:39:27.426ZDEBGnexus (BackgroundTasks): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "72808698-160e-4433-8d15-316724044437", "date": "Thu, 16 Jan 2025 23:39:27 GMT"} })
95772025-01-16T23:39:27.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95782025-01-16T23:39:27.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95792025-01-16T23:39:27.427ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 423.503023ms iteration = 32 status = {}
95802025-01-16T23:39:27.429ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95812025-01-16T23:39:27.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95822025-01-16T23:39:27.430ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95832025-01-16T23:39:27.434ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
95842025-01-16T23:39:27.434ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95852025-01-16T23:39:27.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95862025-01-16T23:39:27.435ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95872025-01-16T23:39:27.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95882025-01-16T23:39:27.436ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95892025-01-16T23:39:27.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95902025-01-16T23:39:27.438ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95912025-01-16T23:39:27.441ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
95922025-01-16T23:39:27.441ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95932025-01-16T23:39:27.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95942025-01-16T23:39:27.445ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95952025-01-16T23:39:27.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95962025-01-16T23:39:27.447ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95972025-01-16T23:39:27.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95982025-01-16T23:39:27.449ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95992025-01-16T23:39:27.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96002025-01-16T23:39:27.451ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96012025-01-16T23:39:27.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96022025-01-16T23:39:27.454ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96032025-01-16T23:39:27.454ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96042025-01-16T23:39:27.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96052025-01-16T23:39:27.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96062025-01-16T23:39:27.455ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96072025-01-16T23:39:27.455ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4f81032f-5b5a-4e15-a902-c3dd58627e93, rack_id: 79114303-f678-43f7-aff3-a882c8c99560, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ed94bf96-5c98-4d5e-9580-d87b95e3d576) } rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
96082025-01-16T23:39:27.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96092025-01-16T23:39:27.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96102025-01-16T23:39:27.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96112025-01-16T23:39:27.457ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96122025-01-16T23:39:27.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96132025-01-16T23:39:27.458ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96142025-01-16T23:39:27.461ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
96152025-01-16T23:39:27.461ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96162025-01-16T23:39:27.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96172025-01-16T23:39:27.462ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
96182025-01-16T23:39:27.463ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b33e2815-dbfd-4fa9-979c-b2514417ac15", "content-length": "134", "date": "Thu, 16 Jan 2025 23:39:26 GMT"} })
96192025-01-16T23:39:27.463ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
96202025-01-16T23:39:27.463ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ed94bf96-5c98-4d5e-9580-d87b95e3d576
96212025-01-16T23:39:27.463ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96222025-01-16T23:39:27.463ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
96232025-01-16T23:39:27.463ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
96242025-01-16T23:39:27.463ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96252025-01-16T23:39:27.463ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96262025-01-16T23:39:27.463ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96272025-01-16T23:39:27.463ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
96282025-01-16T23:39:27.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96292025-01-16T23:39:27.463ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96302025-01-16T23:39:27.463ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
96312025-01-16T23:39:27.463ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 79114303-f678-43f7-aff3-a882c8c99560
96322025-01-16T23:39:27.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96332025-01-16T23:39:27.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96342025-01-16T23:39:27.464ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96352025-01-16T23:39:27.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96362025-01-16T23:39:27.465ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
96372025-01-16T23:39:27.465ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96382025-01-16T23:39:27.466ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc7163d1-f720-4c87-8d36-4fb8b2920c18", "content-length": "2", "date": "Thu, 16 Jan 2025 23:39:26 GMT"} })
96392025-01-16T23:39:27.466ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
96402025-01-16T23:39:27.466ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ba49383-03e5-43e1-970b-4db8413d61a9", "content-length": "52", "date": "Thu, 16 Jan 2025 23:39:26 GMT"} })
96412025-01-16T23:39:27.466ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch_location = Switch0
96422025-01-16T23:39:27.466ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
96432025-01-16T23:39:27.469ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
96442025-01-16T23:39:27.469ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96452025-01-16T23:39:27.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96462025-01-16T23:39:27.474ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: a9131c91-4ca4-491f-8265-8e221e38b9ad, kind: Service { id: dc5f3810-93b6-44f1-815c-44411abf99ad }, name: Name("external-dns-dc5f3810-93b6-44f1-815c-44411abf99ad"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 71])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a95ae8ff-aa26-4675-97b6-6b8d75e9ff0e, kind: Service { id: f4635fcc-61fc-4ff9-8203-b560522a972b }, name: Name("external-dns-f4635fcc-61fc-4ff9-8203-b560522a972b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 6])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 37bada54-3ac8-4367-9487-f47381e04cf6, kind: Service { id: bda5150c-3889-413e-a774-9d40d8f8536d }, name: Name("nexus-bda5150c-3889-413e-a774-9d40d8f8536d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b4d3cb4-34c8-4838-94e3-102c732f938c, kind: Service { id: 1d7f4b38-ce97-4d7c-b37c-92212a02a45f }, name: Name("nexus-1d7f4b38-ce97-4d7c-b37c-92212a02a45f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b50b269f-d32a-4af8-be28-7e03354f4d63, kind: Service { id: 1b5ada24-1ce5-4a0b-9c11-3c803e3e9270 }, name: Name("nexus-1b5ada24-1ce5-4a0b-9c11-3c803e3e9270"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
96472025-01-16T23:39:27.474ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96482025-01-16T23:39:27.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96492025-01-16T23:39:27.476ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96502025-01-16T23:39:27.478ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
96512025-01-16T23:39:27.478ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96522025-01-16T23:39:27.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96532025-01-16T23:39:27.479ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
96542025-01-16T23:39:27.479ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: a9131c91-4ca4-491f-8265-8e221e38b9ad, kind: Service { id: dc5f3810-93b6-44f1-815c-44411abf99ad }, name: Name("external-dns-dc5f3810-93b6-44f1-815c-44411abf99ad"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 71])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a95ae8ff-aa26-4675-97b6-6b8d75e9ff0e, kind: Service { id: f4635fcc-61fc-4ff9-8203-b560522a972b }, name: Name("external-dns-f4635fcc-61fc-4ff9-8203-b560522a972b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 6])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 37bada54-3ac8-4367-9487-f47381e04cf6, kind: Service { id: bda5150c-3889-413e-a774-9d40d8f8536d }, name: Name("nexus-bda5150c-3889-413e-a774-9d40d8f8536d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b4d3cb4-34c8-4838-94e3-102c732f938c, kind: Service { id: 1d7f4b38-ce97-4d7c-b37c-92212a02a45f }, name: Name("nexus-1d7f4b38-ce97-4d7c-b37c-92212a02a45f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b50b269f-d32a-4af8-be28-7e03354f4d63, kind: Service { id: 1b5ada24-1ce5-4a0b-9c11-3c803e3e9270 }, name: Name("nexus-1b5ada24-1ce5-4a0b-9c11-3c803e3e9270"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
96552025-01-16T23:39:27.479ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
96562025-01-16T23:39:27.580ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 198593b5-c3c6-4ef5-879a-52095a2ef511, time_created: 2025-01-16T23:25:11.806143Z, time_modified: 2025-01-16T23:25:11.806143Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 79114303-f678-43f7-aff3-a882c8c99560, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
96572025-01-16T23:39:27.580ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
96582025-01-16T23:39:27.580ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96592025-01-16T23:39:27.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96602025-01-16T23:39:27.583ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96612025-01-16T23:39:27.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96622025-01-16T23:39:27.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96632025-01-16T23:39:27.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 198593b5-c3c6-4ef5-879a-52095a2ef511, lookup_type: ById(198593b5-c3c6-4ef5-879a-52095a2ef511) } result = Ok(())
96642025-01-16T23:39:27.621ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
96652025-01-16T23:39:27.622ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 198593b5-c3c6-4ef5-879a-52095a2ef511 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "46cd1bfa-bacd-43fd-8342-643536032be3", "date": "Thu, 16 Jan 2025 23:39:27 GMT"} })
96662025-01-16T23:39:27.623ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
96672025-01-16T23:39:27.623ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 619.274964ms
96682025-01-16T23:39:27.623ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 619.286874ms iteration = 4 status = {}
96692025-01-16T23:39:27.651ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e0661137-3c67-4664-b187-6a173d758302", "date": "Thu, 16 Jan 2025 23:39:27 GMT"} })
96702025-01-16T23:39:27.651ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 79114303-f678-43f7-aff3-a882c8c99560 switch = Switch0
96712025-01-16T23:39:27.651ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 79114303-f678-43f7-aff3-a882c8c99560 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
96722025-01-16T23:39:27.651ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 79114303-f678-43f7-aff3-a882c8c99560 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "df9b9fd9-0bdd-4923-96d3-4a9b00f67ceb", "content-length": "682", "date": "Thu, 16 Jan 2025 23:39:27 GMT"} })
96732025-01-16T23:39:27.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96742025-01-16T23:39:27.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96752025-01-16T23:39:27.655ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96762025-01-16T23:39:27.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96772025-01-16T23:39:27.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96782025-01-16T23:39:27.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96792025-01-16T23:39:27.661ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96802025-01-16T23:39:27.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96812025-01-16T23:39:27.669ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 665.191986ms iteration = 31 status = {}
96822025-01-16T23:39:28.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 54ac05fd-f307-417b-8e46-877290ebaffc roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96832025-01-16T23:39:28.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 54ac05fd-f307-417b-8e46-877290ebaffc resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96842025-01-16T23:39:28.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 54ac05fd-f307-417b-8e46-877290ebaffc response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96852025-01-16T23:39:29.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c8387010-5a89-41b0-a030-2e7e163095f4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96862025-01-16T23:39:29.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c8387010-5a89-41b0-a030-2e7e163095f4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96872025-01-16T23:39:29.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = c8387010-5a89-41b0-a030-2e7e163095f4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96882025-01-16T23:39:30.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6c2f6088-4548-4d06-9dfc-e9907bd20f58 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96892025-01-16T23:39:30.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6c2f6088-4548-4d06-9dfc-e9907bd20f58 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96902025-01-16T23:39:30.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 6c2f6088-4548-4d06-9dfc-e9907bd20f58 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96912025-01-16T23:39:31.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 64546141-8a5d-4bce-9765-1f4a8e28dff3 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96922025-01-16T23:39:31.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 64546141-8a5d-4bce-9765-1f4a8e28dff3 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96932025-01-16T23:39:31.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 64546141-8a5d-4bce-9765-1f4a8e28dff3 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96942025-01-16T23:39:32.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f78651df-7c01-46f9-b25d-f8db474c1a43 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96952025-01-16T23:39:32.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f78651df-7c01-46f9-b25d-f8db474c1a43 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96962025-01-16T23:39:32.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = f78651df-7c01-46f9-b25d-f8db474c1a43 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96972025-01-16T23:39:33.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 546b9eeb-7b2f-45c4-8ad4-9e119a6edcb8 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96982025-01-16T23:39:33.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 546b9eeb-7b2f-45c4-8ad4-9e119a6edcb8 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
96992025-01-16T23:39:33.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 546b9eeb-7b2f-45c4-8ad4-9e119a6edcb8 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97002025-01-16T23:39:34.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5143a274-93b3-4a88-be70-7dea46bf6cf4 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97012025-01-16T23:39:34.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5143a274-93b3-4a88-be70-7dea46bf6cf4 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97022025-01-16T23:39:34.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 5143a274-93b3-4a88-be70-7dea46bf6cf4 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97032025-01-16T23:39:35.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0a43152f-d829-41be-aaf7-6007b50ce470 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97042025-01-16T23:39:35.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0a43152f-d829-41be-aaf7-6007b50ce470 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97052025-01-16T23:39:35.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0a43152f-d829-41be-aaf7-6007b50ce470 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97062025-01-16T23:39:35.735ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 531 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 7c26e95a-bd2c-4ff4-b28b-e085779d01e4 response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
97072025-01-16T23:39:36.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 25c27f20-cc4d-43d3-9a67-ed895182ae0b roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97082025-01-16T23:39:36.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 25c27f20-cc4d-43d3-9a67-ed895182ae0b resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97092025-01-16T23:39:36.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 25c27f20-cc4d-43d3-9a67-ed895182ae0b response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97102025-01-16T23:39:37.004ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
97112025-01-16T23:39:37.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97122025-01-16T23:39:37.004ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
97132025-01-16T23:39:37.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97142025-01-16T23:39:37.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97152025-01-16T23:39:37.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97162025-01-16T23:39:37.007ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97172025-01-16T23:39:37.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97182025-01-16T23:39:37.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97192025-01-16T23:39:37.008ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.985337ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97202025-01-16T23:39:37.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97212025-01-16T23:39:37.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97222025-01-16T23:39:37.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97232025-01-16T23:39:37.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97242025-01-16T23:39:37.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97252025-01-16T23:39:37.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97262025-01-16T23:39:37.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
97272025-01-16T23:39:37.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97282025-01-16T23:39:37.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97292025-01-16T23:39:37.028ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
97302025-01-16T23:39:37.028ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.634484ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
97312025-01-16T23:39:37.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0a1ee217-6b32-4879-8073-5f773a03e174 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97322025-01-16T23:39:37.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0a1ee217-6b32-4879-8073-5f773a03e174 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97332025-01-16T23:39:37.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 0a1ee217-6b32-4879-8073-5f773a03e174 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97342025-01-16T23:39:38.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 89e1f0ff-46f7-44d8-b338-93dff42625de roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97352025-01-16T23:39:38.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 89e1f0ff-46f7-44d8-b338-93dff42625de resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97362025-01-16T23:39:38.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 89e1f0ff-46f7-44d8-b338-93dff42625de response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97372025-01-16T23:39:39.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 68075bcb-74e3-49b0-a61e-76181e0cff01 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97382025-01-16T23:39:39.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 68075bcb-74e3-49b0-a61e-76181e0cff01 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97392025-01-16T23:39:39.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 68075bcb-74e3-49b0-a61e-76181e0cff01 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97402025-01-16T23:39:40.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 058a93ce-26f4-4598-9166-abfb6c630590 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97412025-01-16T23:39:40.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 058a93ce-26f4-4598-9166-abfb6c630590 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97422025-01-16T23:39:40.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 058a93ce-26f4-4598-9166-abfb6c630590 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97432025-01-16T23:39:41.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 693ce40b-7892-49f0-adfc-74f93f6c9588 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97442025-01-16T23:39:41.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 693ce40b-7892-49f0-adfc-74f93f6c9588 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97452025-01-16T23:39:41.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 693ce40b-7892-49f0-adfc-74f93f6c9588 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97462025-01-16T23:39:42.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e1802da0-ad8f-49a0-969c-c9da60042b0e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97472025-01-16T23:39:42.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e1802da0-ad8f-49a0-969c-c9da60042b0e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97482025-01-16T23:39:42.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2660 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = e1802da0-ad8f-49a0-969c-c9da60042b0e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97492025-01-16T23:39:43.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 43efc108-3cef-480a-9fdc-ec27ac5db9ff roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97502025-01-16T23:39:43.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 43efc108-3cef-480a-9fdc-ec27ac5db9ff resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97512025-01-16T23:39:43.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 43efc108-3cef-480a-9fdc-ec27ac5db9ff response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97522025-01-16T23:39:44.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 50e0db6b-4e42-4488-aacb-214ace1484a5 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97532025-01-16T23:39:44.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 50e0db6b-4e42-4488-aacb-214ace1484a5 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97542025-01-16T23:39:44.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 50e0db6b-4e42-4488-aacb-214ace1484a5 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97552025-01-16T23:39:45.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 607e50f2-08ad-4790-9de9-9eb2c2f08a34 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97562025-01-16T23:39:45.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 607e50f2-08ad-4790-9de9-9eb2c2f08a34 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97572025-01-16T23:39:45.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 607e50f2-08ad-4790-9de9-9eb2c2f08a34 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97582025-01-16T23:39:45.736ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 785 local_addr = [fd00:1122:3344:101::c]:32969 method = GET remote_addr = [fd00:1122:3344:101::d]:63329 req_id = 0190b66d-728a-4638-9bef-85f530a3a68c response_code = 200 uri = /1d7f4b38-ce97-4d7c-b37c-92212a02a45f
97592025-01-16T23:39:46.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 410a0a0c-e192-419a-85ca-e6fbba8bb58e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97602025-01-16T23:39:46.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 410a0a0c-e192-419a-85ca-e6fbba8bb58e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97612025-01-16T23:39:46.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 410a0a0c-e192-419a-85ca-e6fbba8bb58e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97622025-01-16T23:39:47.004ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 93 reason = Timeout
97632025-01-16T23:39:47.004ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 93 reason = Timeout
97642025-01-16T23:39:47.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97652025-01-16T23:39:47.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97662025-01-16T23:39:47.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97672025-01-16T23:39:47.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97682025-01-16T23:39:47.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97692025-01-16T23:39:47.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97702025-01-16T23:39:47.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97712025-01-16T23:39:47.008ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.945905ms iteration = 93 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97722025-01-16T23:39:47.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97732025-01-16T23:39:47.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97742025-01-16T23:39:47.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97752025-01-16T23:39:47.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97762025-01-16T23:39:47.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97772025-01-16T23:39:47.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97782025-01-16T23:39:47.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a0084857-e1b0-49b5-bf1a-36afccdaf1ca, lookup_type: ById(a0084857-e1b0-49b5-bf1a-36afccdaf1ca) } result = Ok(())
97792025-01-16T23:39:47.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97802025-01-16T23:39:47.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97812025-01-16T23:39:47.023ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca original_time_created = 2025-01-16 23:24:15.428233 UTC target_id = a0084857-e1b0-49b5-bf1a-36afccdaf1ca time_created = 2025-01-16 23:24:15.428233 UTC
97822025-01-16T23:39:47.023ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.105017ms iteration = 93 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a0084857-e1b0-49b5-bf1a-36afccdaf1ca","time_created":"2025-01-16T23:24:15.428233Z"}
97832025-01-16T23:39:47.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ac3889dc-5cb1-4349-b107-5ce851bc9064 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97842025-01-16T23:39:47.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ac3889dc-5cb1-4349-b107-5ce851bc9064 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97852025-01-16T23:39:47.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = ac3889dc-5cb1-4349-b107-5ce851bc9064 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97862025-01-16T23:39:48.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 590c2d27-046e-432b-b983-cb094fef749e roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97872025-01-16T23:39:48.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 590c2d27-046e-432b-b983-cb094fef749e resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97882025-01-16T23:39:48.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 590c2d27-046e-432b-b983-cb094fef749e response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97892025-01-16T23:39:49.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 963b745a-017b-4374-bc04-9b7bbe1cfd44 roles = RoleSet { roles: {} } uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97902025-01-16T23:39:49.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 963b745a-017b-4374-bc04-9b7bbe1cfd44 resource = Database result = Ok(()) uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511
97912025-01-16T23:39:49.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = 963b745a-017b-4374-bc04-9b7bbe1cfd44 response_code = 200 uri = /probes/198593b5-c3c6-4ef5-879a-52095a2ef511