Max level shown:
12024-12-21T08:30:01.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
22024-12-21T08:30:01.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32024-12-21T08:30:01.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
42024-12-21T08:30:01.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52024-12-21T08:30:01.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62024-12-21T08:30:01.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72024-12-21T08:30:01.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82024-12-21T08:30:01.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92024-12-21T08:30:01.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102024-12-21T08:30:01.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112024-12-21T08:30:01.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122024-12-21T08:30:01.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132024-12-21T08:30:01.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142024-12-21T08:30:01.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
152024-12-21T08:30:01.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
162024-12-21T08:30:01.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
172024-12-21T08:30:01.557ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
182024-12-21T08:30:01.557ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.45346ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
192024-12-21T08:30:01.564ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
202024-12-21T08:30:01.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
212024-12-21T08:30:01.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.366079ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
222024-12-21T08:30:01.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2fe3892c-2553-416e-929b-80aaccf2ad66 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
232024-12-21T08:30:01.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2fe3892c-2553-416e-929b-80aaccf2ad66 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
242024-12-21T08:30:01.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2fe3892c-2553-416e-929b-80aaccf2ad66 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
252024-12-21T08:30:02.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 15754d3b-605c-47ae-9c8d-0cb530e42178 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
262024-12-21T08:30:02.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 15754d3b-605c-47ae-9c8d-0cb530e42178 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
272024-12-21T08:30:02.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 15754d3b-605c-47ae-9c8d-0cb530e42178 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
282024-12-21T08:30:03.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 19204fea-8cac-4c33-bff0-3dcdafac49b1 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
292024-12-21T08:30:03.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 19204fea-8cac-4c33-bff0-3dcdafac49b1 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
302024-12-21T08:30:03.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 19204fea-8cac-4c33-bff0-3dcdafac49b1 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
312024-12-21T08:30:04.530ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1288 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = f426461e-f084-4f83-ae0c-c7532bb5b51d response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
322024-12-21T08:30:04.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dbc6d939-2ad7-468e-9f11-d82d182fd88f roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
332024-12-21T08:30:04.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dbc6d939-2ad7-468e-9f11-d82d182fd88f resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
342024-12-21T08:30:04.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2667 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dbc6d939-2ad7-468e-9f11-d82d182fd88f response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
352024-12-21T08:30:05.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7cf8beca-5d11-42eb-9fd3-de0a895bb6bd roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
362024-12-21T08:30:05.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7cf8beca-5d11-42eb-9fd3-de0a895bb6bd resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
372024-12-21T08:30:05.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7cf8beca-5d11-42eb-9fd3-de0a895bb6bd response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
382024-12-21T08:30:06.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 5b2ea896-a1c9-436e-8056-0245a44b0e58 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
392024-12-21T08:30:06.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 5b2ea896-a1c9-436e-8056-0245a44b0e58 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
402024-12-21T08:30:06.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 5b2ea896-a1c9-436e-8056-0245a44b0e58 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
412024-12-21T08:30:07.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a2a24c1a-ae99-4f21-a692-f1aa3cd911d9 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
422024-12-21T08:30:07.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a2a24c1a-ae99-4f21-a692-f1aa3cd911d9 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
432024-12-21T08:30:07.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a2a24c1a-ae99-4f21-a692-f1aa3cd911d9 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
442024-12-21T08:30:08.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = abd1bc60-4498-424c-bb91-1d6ee8e7389e roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
452024-12-21T08:30:08.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = abd1bc60-4498-424c-bb91-1d6ee8e7389e resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
462024-12-21T08:30:08.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = abd1bc60-4498-424c-bb91-1d6ee8e7389e response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
472024-12-21T08:30:09.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = aff6f0ff-99ca-4eef-bf97-b7f5b73bf66d roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
482024-12-21T08:30:09.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = aff6f0ff-99ca-4eef-bf97-b7f5b73bf66d resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
492024-12-21T08:30:09.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = aff6f0ff-99ca-4eef-bf97-b7f5b73bf66d response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
502024-12-21T08:30:10.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 5373cf7e-7175-43ed-9858-498874404c7d roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
512024-12-21T08:30:10.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 5373cf7e-7175-43ed-9858-498874404c7d resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
522024-12-21T08:30:10.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 5373cf7e-7175-43ed-9858-498874404c7d response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
532024-12-21T08:30:11.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
542024-12-21T08:30:11.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
552024-12-21T08:30:11.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
562024-12-21T08:30:11.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
572024-12-21T08:30:11.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
582024-12-21T08:30:11.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
592024-12-21T08:30:11.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
602024-12-21T08:30:11.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
612024-12-21T08:30:11.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
622024-12-21T08:30:11.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
632024-12-21T08:30:11.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
642024-12-21T08:30:11.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
652024-12-21T08:30:11.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
662024-12-21T08:30:11.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
672024-12-21T08:30:11.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
682024-12-21T08:30:11.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
692024-12-21T08:30:11.570ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
702024-12-21T08:30:11.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
712024-12-21T08:30:11.572ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.900098ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
722024-12-21T08:30:11.586ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
732024-12-21T08:30:11.586ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.265296ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
742024-12-21T08:30:11.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e47e51f3-4261-4e30-b6dd-2fdbe37bf47c roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
752024-12-21T08:30:11.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e47e51f3-4261-4e30-b6dd-2fdbe37bf47c resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
762024-12-21T08:30:11.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1756 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e47e51f3-4261-4e30-b6dd-2fdbe37bf47c response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
772024-12-21T08:30:12.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6aa5bb18-748c-476b-a2cc-ef3422a4bd08 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
782024-12-21T08:30:12.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6aa5bb18-748c-476b-a2cc-ef3422a4bd08 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
792024-12-21T08:30:12.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6aa5bb18-748c-476b-a2cc-ef3422a4bd08 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
802024-12-21T08:30:13.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 847d8f6e-10d8-4473-9a48-49d1542dd0ad roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
812024-12-21T08:30:13.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 847d8f6e-10d8-4473-9a48-49d1542dd0ad resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
822024-12-21T08:30:13.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 847d8f6e-10d8-4473-9a48-49d1542dd0ad response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
832024-12-21T08:30:14.530ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1439 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = a5d886c9-df78-48b5-808c-c9d3959a0dd4 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
842024-12-21T08:30:14.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = a517903e-1215-4f54-b3e1-83ec0fd10952 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
852024-12-21T08:30:14.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = a517903e-1215-4f54-b3e1-83ec0fd10952 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
862024-12-21T08:30:14.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3855 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = a517903e-1215-4f54-b3e1-83ec0fd10952 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
872024-12-21T08:30:14.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = be4a9795-9560-4ae5-a72e-b8129c213e0e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
882024-12-21T08:30:14.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = be4a9795-9560-4ae5-a72e-b8129c213e0e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
892024-12-21T08:30:14.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = be4a9795-9560-4ae5-a72e-b8129c213e0e response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
902024-12-21T08:30:14.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 879d3f55-8dad-4db9-a1e1-8cfb08b5afd3 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
912024-12-21T08:30:14.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 879d3f55-8dad-4db9-a1e1-8cfb08b5afd3 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
922024-12-21T08:30:14.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 879d3f55-8dad-4db9-a1e1-8cfb08b5afd3 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
932024-12-21T08:30:16.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 10150dc4-7f32-4b46-8f61-3573bfb0d7a2 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
942024-12-21T08:30:16.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 10150dc4-7f32-4b46-8f61-3573bfb0d7a2 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
952024-12-21T08:30:16.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 10150dc4-7f32-4b46-8f61-3573bfb0d7a2 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
962024-12-21T08:30:17.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 1554ab64-44a0-4a4d-9381-b9e9a4cb8272 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
972024-12-21T08:30:17.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 1554ab64-44a0-4a4d-9381-b9e9a4cb8272 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
982024-12-21T08:30:17.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2622 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 1554ab64-44a0-4a4d-9381-b9e9a4cb8272 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
992024-12-21T08:30:18.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f24cd932-a3b4-45ef-a31e-88c024318f78 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
1002024-12-21T08:30:18.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f24cd932-a3b4-45ef-a31e-88c024318f78 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
1012024-12-21T08:30:18.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f24cd932-a3b4-45ef-a31e-88c024318f78 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
1022024-12-21T08:30:19.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e1566b7e-b987-4673-b473-a5a32aea5385 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
1032024-12-21T08:30:19.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e1566b7e-b987-4673-b473-a5a32aea5385 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
1042024-12-21T08:30:19.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e1566b7e-b987-4673-b473-a5a32aea5385 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
1052024-12-21T08:30:20.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3747a4d1-0e6c-499e-bea6-af6572e8d9f3 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
1062024-12-21T08:30:20.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3747a4d1-0e6c-499e-bea6-af6572e8d9f3 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
1072024-12-21T08:30:20.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3747a4d1-0e6c-499e-bea6-af6572e8d9f3 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
1082024-12-21T08:30:21.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2c846880-1dab-493f-a26d-4ac8e029db81 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
1092024-12-21T08:30:21.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2c846880-1dab-493f-a26d-4ac8e029db81 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
1102024-12-21T08:30:21.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2c846880-1dab-493f-a26d-4ac8e029db81 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
1112024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
1122024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
1132024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1142024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
1152024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
1162024-12-21T08:30:21.530ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302
1172024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1182024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.171\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302"}
1192024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
1202024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
1212024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1222024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
1232024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1242024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1252024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
1262024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
1272024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1282024-12-21T08:30:21.530ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 08:20:21.530150984 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1292024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
1302024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1312024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
1322024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1332024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1342024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1352024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
1362024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1372024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
1382024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1392024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
1402024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1412024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
1422024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1432024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
1442024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1452024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
1462024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1472024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
1482024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
1492024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1502024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
1512024-12-21T08:30:21.530ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1522024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1532024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
1542024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1552024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
1562024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
1572024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1582024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1592024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
1602024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
1612024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
1622024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1632024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
1642024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1652024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
1662024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1672024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1682024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
1692024-12-21T08:30:21.530ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1702024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1712024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
1722024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1732024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
1742024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1752024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1762024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1772024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1782024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1792024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1802024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1812024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1822024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1832024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1842024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1852024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1862024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1872024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1882024-12-21T08:30:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1892024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1902024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1912024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1922024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1932024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1942024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1952024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1962024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1972024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1982024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1992024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2002024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2012024-12-21T08:30:21.531ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5037fa1b-4769-431c-8e17-0ed172e6d4e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea826706-9f75-4635-8793-1730a859a368.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea826706-9f75-4635-8793-1730a859a368.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1703, tv_nsec: 520947509 } })
2022024-12-21T08:30:21.531ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("35bcbd45-3578-45df-b73d-00c21093df02.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50a4d151-f70f-4790-a525-028d2812625b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bdf4fa9e-0938-4aac-903e-8935b21f0685.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bdf4fa9e-0938-4aac-903e-8935b21f0685.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1703, tv_nsec: 520960339 } })
2032024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2042024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2052024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2062024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2072024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2082024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2092024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
2102024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.425672ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
2112024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
2122024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.16411ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
2132024-12-21T08:30:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2142024-12-21T08:30:21.532ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2152024-12-21T08:30:21.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2162024-12-21T08:30:21.534ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2172024-12-21T08:30:21.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2182024-12-21T08:30:21.534ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.339018ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2192024-12-21T08:30:21.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2202024-12-21T08:30:21.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2212024-12-21T08:30:21.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2222024-12-21T08:30:21.536ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2232024-12-21T08:30:21.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2242024-12-21T08:30:21.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2252024-12-21T08:30:21.537ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2262024-12-21T08:30:21.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2272024-12-21T08:30:21.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2282024-12-21T08:30:21.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2292024-12-21T08:30:21.542ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 08:20:21.530150984 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2302024-12-21T08:30:21.542ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.004996ms iteration = 13 status = {"expiration":"2024-12-21T08:20:21.530150984Z","pruned":[]}
2312024-12-21T08:30:21.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2322024-12-21T08:30:21.542ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.384049ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
2332024-12-21T08:30:21.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2342024-12-21T08:30:21.547ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1703, tv_nsec: 536885029 } })
2352024-12-21T08:30:21.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
2362024-12-21T08:30:21.549ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1703, tv_nsec: 539076419 } })
2372024-12-21T08:30:21.549ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
2382024-12-21T08:30:21.551ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2392024-12-21T08:30:21.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2402024-12-21T08:30:21.553ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2412024-12-21T08:30:21.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2422024-12-21T08:30:21.556ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2432024-12-21T08:30:21.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2442024-12-21T08:30:21.559ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2452024-12-21T08:30:21.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2462024-12-21T08:30:21.573ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2472024-12-21T08:30:21.573ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2482024-12-21T08:30:21.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2492024-12-21T08:30:21.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2502024-12-21T08:30:21.575ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.208728ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
2512024-12-21T08:30:21.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2522024-12-21T08:30:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2532024-12-21T08:30:21.589ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2542024-12-21T08:30:21.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2552024-12-21T08:30:21.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2562024-12-21T08:30:21.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2572024-12-21T08:30:21.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2582024-12-21T08:30:21.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2592024-12-21T08:30:21.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2602024-12-21T08:30:21.596ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2612024-12-21T08:30:21.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2622024-12-21T08:30:21.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2632024-12-21T08:30:21.599ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.876997ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
2642024-12-21T08:30:21.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2652024-12-21T08:30:21.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2662024-12-21T08:30:21.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2672024-12-21T08:30:21.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2682024-12-21T08:30:21.605ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2692024-12-21T08:30:21.605ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2702024-12-21T08:30:21.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2712024-12-21T08:30:21.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2722024-12-21T08:30:21.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2732024-12-21T08:30:21.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2742024-12-21T08:30:21.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1703, tv_nsec: 597787017 } })
2752024-12-21T08:30:21.608ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
2762024-12-21T08:30:21.608ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2772024-12-21T08:30:21.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2782024-12-21T08:30:21.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2792024-12-21T08:30:21.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
2802024-12-21T08:30:21.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2812024-12-21T08:30:21.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2822024-12-21T08:30:21.610ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2832024-12-21T08:30:21.610ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2842024-12-21T08:30:21.610ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 80.175067ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2852024-12-21T08:30:21.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2862024-12-21T08:30:21.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2872024-12-21T08:30:21.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2882024-12-21T08:30:21.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2892024-12-21T08:30:21.611ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2902024-12-21T08:30:21.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2912024-12-21T08:30:21.611ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2922024-12-21T08:30:21.611ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2932024-12-21T08:30:21.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2942024-12-21T08:30:21.613ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2952024-12-21T08:30:21.613ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2962024-12-21T08:30:21.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2972024-12-21T08:30:21.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2982024-12-21T08:30:21.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2992024-12-21T08:30:21.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
3002024-12-21T08:30:21.614ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
3012024-12-21T08:30:21.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3022024-12-21T08:30:21.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
3032024-12-21T08:30:21.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3042024-12-21T08:30:21.614ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3052024-12-21T08:30:21.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3062024-12-21T08:30:21.614ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3072024-12-21T08:30:21.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.572334ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3082024-12-21T08:30:21.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3092024-12-21T08:30:21.616ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3102024-12-21T08:30:21.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
3112024-12-21T08:30:21.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3122024-12-21T08:30:21.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
3132024-12-21T08:30:21.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3142024-12-21T08:30:21.616ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3152024-12-21T08:30:21.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3162024-12-21T08:30:21.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
3172024-12-21T08:30:21.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3182024-12-21T08:30:21.618ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3192024-12-21T08:30:21.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3202024-12-21T08:30:21.621ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3212024-12-21T08:30:21.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3222024-12-21T08:30:21.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3232024-12-21T08:30:21.624ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3242024-12-21T08:30:21.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3252024-12-21T08:30:21.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3262024-12-21T08:30:21.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.612413ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3272024-12-21T08:30:21.626ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 96.31985ms iteration = 6 status = {"nsuccess":5}
3282024-12-21T08:30:21.627ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3292024-12-21T08:30:21.627ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3302024-12-21T08:30:21.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3312024-12-21T08:30:21.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3322024-12-21T08:30:21.630ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3332024-12-21T08:30:21.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3342024-12-21T08:30:21.632ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
3352024-12-21T08:30:21.632ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 102.561895ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
3362024-12-21T08:30:21.642ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3372024-12-21T08:30:21.643ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3382024-12-21T08:30:21.643ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3392024-12-21T08:30:21.643ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3402024-12-21T08:30:21.643ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3412024-12-21T08:30:21.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3422024-12-21T08:30:21.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3432024-12-21T08:30:21.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3442024-12-21T08:30:21.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3452024-12-21T08:30:21.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3462024-12-21T08:30:21.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3472024-12-21T08:30:21.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3482024-12-21T08:30:21.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 121.430001ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3492024-12-21T08:30:21.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3502024-12-21T08:30:21.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3512024-12-21T08:30:21.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3522024-12-21T08:30:21.654ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 124.455568ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
3532024-12-21T08:30:21.657ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3542024-12-21T08:30:21.657ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3552024-12-21T08:30:21.657ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 127.505185ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3562024-12-21T08:30:21.672ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3572024-12-21T08:30:21.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3582024-12-21T08:30:21.673ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3592024-12-21T08:30:21.677ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3602024-12-21T08:30:21.677ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
3612024-12-21T08:30:21.677ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 147.505422ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3622024-12-21T08:30:21.683ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3632024-12-21T08:30:21.683ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3642024-12-21T08:30:21.683ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3652024-12-21T08:30:21.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3662024-12-21T08:30:21.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3672024-12-21T08:30:21.685ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3682024-12-21T08:30:21.685ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e0ed7f2-a28d-41ab-87a3-81b7138901c7 dns_zone_name = oxide.test found_so_far = 0 version = 2
3692024-12-21T08:30:21.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3702024-12-21T08:30:21.686ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3712024-12-21T08:30:21.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3722024-12-21T08:30:21.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3732024-12-21T08:30:21.691ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3742024-12-21T08:30:21.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3b53ba2d-4d00-44a6-bd37-8306adc194ea, lookup_type: ById(3b53ba2d-4d00-44a6-bd37-8306adc194ea) } result = Ok(())
3752024-12-21T08:30:21.693ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3762024-12-21T08:30:21.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3772024-12-21T08:30:21.703ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3782024-12-21T08:30:21.703ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3792024-12-21T08:30:21.703ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3ab2816-fc25-4f34-8c1e-644526900386", "content-length": "26", "date": "Sat, 21 Dec 2024 08:30:21 GMT"} })
3802024-12-21T08:30:21.703ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3812024-12-21T08:30:21.705ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3822024-12-21T08:30:21.734ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
3832024-12-21T08:30:21.734ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 204.397754ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
3842024-12-21T08:30:21.739ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 209.452528ms iteration = 29 status = {"physical_disks_added":0}
3852024-12-21T08:30:21.783ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
3862024-12-21T08:30:21.789ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 zone_address = fd00:1122:3344:101::2
3872024-12-21T08:30:21.789ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3882024-12-21T08:30:21.789ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "21a4775e-5caa-4c2e-83bb-45f471936940", "content-length": "26", "date": "Sat, 21 Dec 2024 08:30:21 GMT"} })
3892024-12-21T08:30:21.789ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3902024-12-21T08:30:21.791ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
3912024-12-21T08:30:21.847ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
3922024-12-21T08:30:21.847ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1b65f5e6-6832-4486-9fd0-9058a3264562", "date": "Sat, 21 Dec 2024 08:30:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3932024-12-21T08:30:21.847ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3942024-12-21T08:30:21.848ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "aab14b8a-ab96-4a91-ad8b-f3905b233fdf", "date": "Sat, 21 Dec 2024 08:30:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3952024-12-21T08:30:21.848ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3962024-12-21T08:30:21.850ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3972024-12-21T08:30:21.850ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 320.391826ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
3982024-12-21T08:30:21.866ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3992024-12-21T08:30:21.866ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4002024-12-21T08:30:21.867ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1e638a8-8556-44ce-86c8-3e3aafe54869", "content-length": "26", "date": "Sat, 21 Dec 2024 08:30:21 GMT"} })
4012024-12-21T08:30:21.867ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4022024-12-21T08:30:21.869ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4032024-12-21T08:30:21.894ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4042024-12-21T08:30:21.894ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4052024-12-21T08:30:21.895ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a833d2b8-5bbf-4df4-9066-708328b13a1d", "content-length": "523", "date": "Sat, 21 Dec 2024 08:30:21 GMT"} })
4062024-12-21T08:30:21.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4072024-12-21T08:30:21.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4082024-12-21T08:30:21.913ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 383.386102ms iteration = 25 status = {}
4092024-12-21T08:30:21.924ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/a228df23-9207-434c-917e-97e43676157c/state
4102024-12-21T08:30:21.926ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4112024-12-21T08:30:21.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4122024-12-21T08:30:21.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4132024-12-21T08:30:21.929ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4142024-12-21T08:30:21.929ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4152024-12-21T08:30:21.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4162024-12-21T08:30:21.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4172024-12-21T08:30:21.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4182024-12-21T08:30:21.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4192024-12-21T08:30:21.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4202024-12-21T08:30:21.931ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4212024-12-21T08:30:21.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4222024-12-21T08:30:21.934ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 403.629951ms iteration = 25 status = 0
4232024-12-21T08:30:21.936ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e0ed7f2-a28d-41ab-87a3-81b7138901c7 dns_zone_name = oxide.test found_so_far = 1 version = 2
4242024-12-21T08:30:21.936ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
4252024-12-21T08:30:21.936ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 08:18:23.563952 UTC dns_group = external generation = 2
4262024-12-21T08:30:21.936ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 406.287704ms iteration = 14 status = {"generation":2}
4272024-12-21T08:30:21.967ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4282024-12-21T08:30:21.986ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4292024-12-21T08:30:21.987ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f946fb66-bb35-447c-96d6-500343edcf76", "content-length": "1", "date": "Sat, 21 Dec 2024 08:30:21 GMT"} })
4302024-12-21T08:30:21.990ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
4312024-12-21T08:30:21.990ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 825f8681-b5f6-43ad-8053-b0be9965d93d dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
4322024-12-21T08:30:21.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4332024-12-21T08:30:21.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4342024-12-21T08:30:21.991ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4352024-12-21T08:30:21.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4362024-12-21T08:30:21.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4372024-12-21T08:30:21.993ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 463.265476ms iteration = 25 status = null
4382024-12-21T08:30:21.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4392024-12-21T08:30:21.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4402024-12-21T08:30:21.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4412024-12-21T08:30:21.997ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T08:18:19.279666Z, time_modified: 2024-12-21T08:18:19.279666Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 36ce767e-8d13-48fc-b54f-25a543752b28, db_silo: Silo { identity: SiloIdentity { id: 36ce767e-8d13-48fc-b54f-25a543752b28, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T08:18:23.511483Z, time_modified: 2024-12-21T08:18:23.511483Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d4d3d1815f342882ad1c1687b3d9b611837e26888f379a800d2fbe2710458245" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 36ce767e-8d13-48fc-b54f-25a543752b28, db_silo: Silo { identity: SiloIdentity { id: 36ce767e-8d13-48fc-b54f-25a543752b28, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T08:18:23.511483Z, time_modified: 2024-12-21T08:18:23.511483Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d4d3d1815f342882ad1c1687b3d9b611837e26888f379a800d2fbe2710458245" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
4422024-12-21T08:30:21.997ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 466.895508ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"36ce767e-8d13-48fc-b54f-25a543752b28","tls_certs":["d4d3d1815f342882ad1c1687b3d9b611837e26888f379a800d2fbe2710458245"]}},"default_endpoint":{"silo_id":"36ce767e-8d13-48fc-b54f-25a543752b28","tls_certs":["d4d3d1815f342882ad1c1687b3d9b611837e26888f379a800d2fbe2710458245"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4432024-12-21T08:30:21.998ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 825f8681-b5f6-43ad-8053-b0be9965d93d dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
4442024-12-21T08:30:21.998ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
4452024-12-21T08:30:21.998ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 08:18:22.068410 UTC dns_group = internal generation = 1
4462024-12-21T08:30:21.998ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 467.851566ms iteration = 14 status = {"generation":1}
4472024-12-21T08:30:21.998ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {19c9f3b6-5823-4bf2-b225-3215550c2725: {10.151.1.176: {84f70ef7-c9b2-4948-ac32-a394fef7c674}, 10.151.1.175: {84f70ef7-c9b2-4948-ac32-a394fef7c674}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
4482024-12-21T08:30:21.998ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4492024-12-21T08:30:21.999ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6326cf27-cd30-4f7c-b93a-39849ba7432c", "date": "Sat, 21 Dec 2024 08:30:21 GMT"} })
4502024-12-21T08:30:21.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4512024-12-21T08:30:21.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4522024-12-21T08:30:22.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4532024-12-21T08:30:22.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4542024-12-21T08:30:22.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4552024-12-21T08:30:22.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4562024-12-21T08:30:22.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4572024-12-21T08:30:22.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4582024-12-21T08:30:22.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4592024-12-21T08:30:22.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4602024-12-21T08:30:22.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4612024-12-21T08:30:22.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4622024-12-21T08:30:22.029ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4632024-12-21T08:30:22.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4642024-12-21T08:30:22.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4652024-12-21T08:30:22.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4662024-12-21T08:30:22.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4672024-12-21T08:30:22.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4682024-12-21T08:30:22.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4692024-12-21T08:30:22.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4702024-12-21T08:30:22.041ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4712024-12-21T08:30:22.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4722024-12-21T08:30:22.041ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "88525912-c163-47d0-b447-1f2b48e96942", "date": "Sat, 21 Dec 2024 08:30:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4732024-12-21T08:30:22.041ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4742024-12-21T08:30:22.044ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7327b432-055f-414a-9922-aa5674083b13", "date": "Sat, 21 Dec 2024 08:30:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4752024-12-21T08:30:22.044ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4762024-12-21T08:30:22.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4772024-12-21T08:30:22.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4782024-12-21T08:30:22.047ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "fc302782-a01b-49cb-9c92-0284137bdc80", "date": "Sat, 21 Dec 2024 08:30:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4792024-12-21T08:30:22.047ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4802024-12-21T08:30:22.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4812024-12-21T08:30:22.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4822024-12-21T08:30:22.050ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4832024-12-21T08:30:22.050ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 520.259859ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4842024-12-21T08:30:22.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4852024-12-21T08:30:22.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4862024-12-21T08:30:22.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4872024-12-21T08:30:22.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 36ce767e-8d13-48fc-b54f-25a543752b28, lookup_type: ById(36ce767e-8d13-48fc-b54f-25a543752b28) }, key: 1009ab7d-ffd9-407a-ac31-0cd04694fc56, lookup_type: ById(1009ab7d-ffd9-407a-ac31-0cd04694fc56) }, key: e492264f-4ff4-43aa-bd7c-c5bbe5016fe4, lookup_type: ById(e492264f-4ff4-43aa-bd7c-c5bbe5016fe4) }, key: 7627482c-5e77-4d15-86d0-f3973e8eb244, lookup_type: ById(7627482c-5e77-4d15-86d0-f3973e8eb244) } result = Ok(())
4882024-12-21T08:30:22.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4892024-12-21T08:30:22.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4902024-12-21T08:30:22.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4912024-12-21T08:30:22.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4922024-12-21T08:30:22.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4932024-12-21T08:30:22.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4942024-12-21T08:30:22.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4952024-12-21T08:30:22.075ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4962024-12-21T08:30:22.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4972024-12-21T08:30:22.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4982024-12-21T08:30:22.079ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4992024-12-21T08:30:22.079ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5002024-12-21T08:30:22.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5012024-12-21T08:30:22.079ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 36ce767e-8d13-48fc-b54f-25a543752b28, lookup_type: ById(36ce767e-8d13-48fc-b54f-25a543752b28) }, key: 1009ab7d-ffd9-407a-ac31-0cd04694fc56, lookup_type: ById(1009ab7d-ffd9-407a-ac31-0cd04694fc56) }, key: e492264f-4ff4-43aa-bd7c-c5bbe5016fe4, lookup_type: ById(e492264f-4ff4-43aa-bd7c-c5bbe5016fe4) }, key: 7627482c-5e77-4d15-86d0-f3973e8eb244, lookup_type: ById(7627482c-5e77-4d15-86d0-f3973e8eb244) } result = Ok(())
5022024-12-21T08:30:22.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5032024-12-21T08:30:22.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5042024-12-21T08:30:22.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5052024-12-21T08:30:22.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
5062024-12-21T08:30:22.082ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5072024-12-21T08:30:22.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5082024-12-21T08:30:22.083ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5092024-12-21T08:30:22.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5102024-12-21T08:30:22.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5112024-12-21T08:30:22.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5122024-12-21T08:30:22.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5132024-12-21T08:30:22.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5142024-12-21T08:30:22.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5152024-12-21T08:30:22.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5162024-12-21T08:30:22.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5172024-12-21T08:30:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5182024-12-21T08:30:22.127ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5192024-12-21T08:30:22.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5202024-12-21T08:30:22.140ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
5212024-12-21T08:30:22.140ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e213bb0e-9249-47c5-a599-5200d300955c", "content-length": "810", "date": "Sat, 21 Dec 2024 08:30:21 GMT"} })
5222024-12-21T08:30:22.140ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(7000608) }} sled = buskin
5232024-12-21T08:30:22.140ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
5242024-12-21T08:30:22.140ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
5252024-12-21T08:30:22.142ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 611.951538ms iteration = 25 status = {}
5262024-12-21T08:30:22.142ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5272024-12-21T08:30:22.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5282024-12-21T08:30:22.143ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4986737f-c249-4380-901f-c7ce67751b89, rack_id: dcff325a-cbfd-4a8c-805a-d5b8a1a42707, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a98489e0-d62f-4837-a1f0-df124db3049c) } rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0
5292024-12-21T08:30:22.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5302024-12-21T08:30:22.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5312024-12-21T08:30:22.144ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5322024-12-21T08:30:22.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5332024-12-21T08:30:22.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9fb8de79-0f7f-4126-b38b-ef7c18e11707 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
5342024-12-21T08:30:22.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9fb8de79-0f7f-4126-b38b-ef7c18e11707 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
5352024-12-21T08:30:22.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5362024-12-21T08:30:22.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9fb8de79-0f7f-4126-b38b-ef7c18e11707 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
5372024-12-21T08:30:22.149ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 36ce767e-8d13-48fc-b54f-25a543752b28, lookup_type: ById(36ce767e-8d13-48fc-b54f-25a543752b28) }, key: 1009ab7d-ffd9-407a-ac31-0cd04694fc56, lookup_type: ById(1009ab7d-ffd9-407a-ac31-0cd04694fc56) }, key: e492264f-4ff4-43aa-bd7c-c5bbe5016fe4, lookup_type: ById(e492264f-4ff4-43aa-bd7c-c5bbe5016fe4) }, key: e4d470cd-92ad-4799-80bc-7fc51681ade5, lookup_type: ByName("default") } result = Ok(())
5382024-12-21T08:30:22.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5392024-12-21T08:30:22.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5402024-12-21T08:30:22.151ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5412024-12-21T08:30:22.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5422024-12-21T08:30:22.153ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5432024-12-21T08:30:22.153ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
5442024-12-21T08:30:22.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5452024-12-21T08:30:22.153ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa2b48fd-941d-47cf-bab1-660dd9be43bc", "content-length": "134", "date": "Sat, 21 Dec 2024 08:30:21 GMT"} })
5462024-12-21T08:30:22.153ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
5472024-12-21T08:30:22.153ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a98489e0-d62f-4837-a1f0-df124db3049c
5482024-12-21T08:30:22.154ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
5492024-12-21T08:30:22.154ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5502024-12-21T08:30:22.154ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5512024-12-21T08:30:22.154ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5522024-12-21T08:30:22.154ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5532024-12-21T08:30:22.154ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5542024-12-21T08:30:22.154ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5552024-12-21T08:30:22.154ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5562024-12-21T08:30:22.154ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
5572024-12-21T08:30:22.154ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5582024-12-21T08:30:22.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5592024-12-21T08:30:22.155ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5602024-12-21T08:30:22.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5612024-12-21T08:30:22.156ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
5622024-12-21T08:30:22.156ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "97ee4572-81e3-4bcf-b492-fe26c91d50d4", "content-length": "2", "date": "Sat, 21 Dec 2024 08:30:21 GMT"} })
5632024-12-21T08:30:22.156ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
5642024-12-21T08:30:22.156ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "29658641-5829-4edf-8049-996f49204145", "content-length": "52", "date": "Sat, 21 Dec 2024 08:30:21 GMT"} })
5652024-12-21T08:30:22.156ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0
5662024-12-21T08:30:22.156ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
5672024-12-21T08:30:22.158ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5682024-12-21T08:30:22.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5692024-12-21T08:30:22.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5702024-12-21T08:30:22.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5712024-12-21T08:30:22.161ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5722024-12-21T08:30:22.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5732024-12-21T08:30:22.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5742024-12-21T08:30:22.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 36ce767e-8d13-48fc-b54f-25a543752b28, lookup_type: ById(36ce767e-8d13-48fc-b54f-25a543752b28) }, key: 1009ab7d-ffd9-407a-ac31-0cd04694fc56, lookup_type: ById(1009ab7d-ffd9-407a-ac31-0cd04694fc56) }, key: e492264f-4ff4-43aa-bd7c-c5bbe5016fe4, lookup_type: ById(e492264f-4ff4-43aa-bd7c-c5bbe5016fe4) }, key: 84f70ef7-c9b2-4948-ac32-a394fef7c674, lookup_type: ByName("default") } result = Ok(())
5752024-12-21T08:30:22.168ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
5762024-12-21T08:30:22.269ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8de0f300-5b61-4014-9441-c9f54ad8b128", "date": "Sat, 21 Dec 2024 08:30:21 GMT"} })
5772024-12-21T08:30:22.270ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch = Switch0
5782024-12-21T08:30:22.270ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5792024-12-21T08:30:22.277ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "87c5b207-f722-4136-ac04-b14112ca1284", "content-length": "682", "date": "Sat, 21 Dec 2024 08:30:22 GMT"} })
5802024-12-21T08:30:22.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5812024-12-21T08:30:22.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5822024-12-21T08:30:22.278ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0fb553c7-d84a-4b20-91bf-e2798d210d31", "date": "Sat, 21 Dec 2024 08:30:22 GMT"} })
5832024-12-21T08:30:22.280ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 750.244567ms iteration = 26 status = {}
5842024-12-21T08:30:22.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5852024-12-21T08:30:22.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5862024-12-21T08:30:22.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5872024-12-21T08:30:22.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5882024-12-21T08:30:22.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5892024-12-21T08:30:22.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5902024-12-21T08:30:22.334ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 804.347045ms iteration = 25 status = {}
5912024-12-21T08:30:22.524ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:38600
5922024-12-21T08:30:22.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:38600 req_id = 70134ddf-b37e-4dfa-bcca-ad082d2cd187 roles = RoleSet { roles: {} } uri = /metrics/producers
5932024-12-21T08:30:22.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:38600 req_id = 70134ddf-b37e-4dfa-bcca-ad082d2cd187 resource = Database result = Ok(()) uri = /metrics/producers
5942024-12-21T08:30:22.533ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a228df23-9207-434c-917e-97e43676157c remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e8267a12-aeb4-4af9-adcf-a7adeeb45bbf uri = /vmms/a228df23-9207-434c-917e-97e43676157c vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T08:30:22.525826336Z }
5952024-12-21T08:30:22.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e8267a12-aeb4-4af9-adcf-a7adeeb45bbf roles = RoleSet { roles: {} } uri = /vmms/a228df23-9207-434c-917e-97e43676157c
5962024-12-21T08:30:22.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e8267a12-aeb4-4af9-adcf-a7adeeb45bbf resource = Database result = Ok(()) uri = /vmms/a228df23-9207-434c-917e-97e43676157c
5972024-12-21T08:30:22.566ZINFOnexus: assigned collector to new producer collector_id = d3e17b73-750a-4d54-b6e9-cb13b0984ebb file = nexus/src/app/oximeter.rs:76 producer_id = ed7e5504-1095-4d5f-8d41-92548098bd5c
5982024-12-21T08:30:22.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41276 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:38600 req_id = 70134ddf-b37e-4dfa-bcca-ad082d2cd187 response_code = 201 uri = /metrics/producers
5992024-12-21T08:30:22.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53913 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e8267a12-aeb4-4af9-adcf-a7adeeb45bbf response_code = 204 uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6002024-12-21T08:30:22.580ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/a228df23-9207-434c-917e-97e43676157c/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "a759ceeb-8f5d-46b2-b7d0-8c1fbff6798c", "content-length": "131", "date": "Sat, 21 Dec 2024 08:30:21 GMT"} })
6012024-12-21T08:30:22.580ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a228df23-9207-434c-917e-97e43676157c remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a428e83c-00aa-4378-baf6-acc45cd9b486 uri = /vmms/a228df23-9207-434c-917e-97e43676157c vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T08:30:22.580708390Z }
6022024-12-21T08:30:22.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a428e83c-00aa-4378-baf6-acc45cd9b486 roles = RoleSet { roles: {} } uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6032024-12-21T08:30:22.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a428e83c-00aa-4378-baf6-acc45cd9b486 resource = Database result = Ok(()) uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6042024-12-21T08:30:22.583ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c sled_id = 3b53ba2d-4d00-44a6-bd37-8306adc194ea state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T08:30:22.525826336Z }, migration_in: None, migration_out: None } vmm_id = a228df23-9207-434c-917e-97e43676157c
6052024-12-21T08:30:22.583ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2077 instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a228df23-9207-434c-917e-97e43676157c sled_id = 3b53ba2d-4d00-44a6-bd37-8306adc194ea vmm_id = a228df23-9207-434c-917e-97e43676157c vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T08:30:22.525826336Z }
6062024-12-21T08:30:22.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c roles = RoleSet { roles: {} } sled_id = 3b53ba2d-4d00-44a6-bd37-8306adc194ea vmm_id = a228df23-9207-434c-917e-97e43676157c
6072024-12-21T08:30:22.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c resource = Database result = Ok(()) sled_id = 3b53ba2d-4d00-44a6-bd37-8306adc194ea vmm_id = a228df23-9207-434c-917e-97e43676157c
6082024-12-21T08:30:22.590ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
6092024-12-21T08:30:22.592ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 1.06241064s iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
6102024-12-21T08:30:22.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37388 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a428e83c-00aa-4378-baf6-acc45cd9b486 response_code = 204 uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6112024-12-21T08:30:23.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b61005c0-7fe4-40f0-8524-dd90cfa452ec roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6122024-12-21T08:30:23.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b61005c0-7fe4-40f0-8524-dd90cfa452ec resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6132024-12-21T08:30:23.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b61005c0-7fe4-40f0-8524-dd90cfa452ec response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6142024-12-21T08:30:24.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0bba0e67-65b8-4dd0-948a-313cf49fc6d6 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6152024-12-21T08:30:24.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0bba0e67-65b8-4dd0-948a-313cf49fc6d6 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6162024-12-21T08:30:24.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0bba0e67-65b8-4dd0-948a-313cf49fc6d6 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6172024-12-21T08:30:24.530ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1483 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = 38ac008e-29d8-4244-b1ef-ba3f614c1ce8 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
6182024-12-21T08:30:25.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a17f1e1b-aa78-4f9a-9af8-68aeb754175b roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6192024-12-21T08:30:25.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a17f1e1b-aa78-4f9a-9af8-68aeb754175b resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6202024-12-21T08:30:25.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2588 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a17f1e1b-aa78-4f9a-9af8-68aeb754175b response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6212024-12-21T08:30:26.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 445f8787-8c4a-44f2-a5f9-2ddcda00d6ce roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6222024-12-21T08:30:26.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 445f8787-8c4a-44f2-a5f9-2ddcda00d6ce resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6232024-12-21T08:30:26.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 445f8787-8c4a-44f2-a5f9-2ddcda00d6ce response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6242024-12-21T08:30:27.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9e45df91-7c4c-483c-a59c-3e7a857e1ce9 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6252024-12-21T08:30:27.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9e45df91-7c4c-483c-a59c-3e7a857e1ce9 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6262024-12-21T08:30:27.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9e45df91-7c4c-483c-a59c-3e7a857e1ce9 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6272024-12-21T08:30:28.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 848ca014-01be-4500-90ee-0b74c74ca8bf roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6282024-12-21T08:30:28.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 848ca014-01be-4500-90ee-0b74c74ca8bf resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6292024-12-21T08:30:28.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 848ca014-01be-4500-90ee-0b74c74ca8bf response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6302024-12-21T08:30:29.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4b671326-4394-4330-9868-5f7b68eb22e1 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6312024-12-21T08:30:29.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4b671326-4394-4330-9868-5f7b68eb22e1 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6322024-12-21T08:30:29.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4b671326-4394-4330-9868-5f7b68eb22e1 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6332024-12-21T08:30:30.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b3896dee-86a3-4a56-96c3-0e0aa7450adc roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6342024-12-21T08:30:30.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b3896dee-86a3-4a56-96c3-0e0aa7450adc resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6352024-12-21T08:30:30.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2765 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b3896dee-86a3-4a56-96c3-0e0aa7450adc response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6362024-12-21T08:30:31.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6702065b-a26f-40fe-a17e-54811846b3dd roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6372024-12-21T08:30:31.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6702065b-a26f-40fe-a17e-54811846b3dd resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6382024-12-21T08:30:31.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6702065b-a26f-40fe-a17e-54811846b3dd response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6392024-12-21T08:30:31.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
6402024-12-21T08:30:31.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
6412024-12-21T08:30:31.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6422024-12-21T08:30:31.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6432024-12-21T08:30:31.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6442024-12-21T08:30:31.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6452024-12-21T08:30:31.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6462024-12-21T08:30:31.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6472024-12-21T08:30:31.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6482024-12-21T08:30:31.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6492024-12-21T08:30:31.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6502024-12-21T08:30:31.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6512024-12-21T08:30:31.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6522024-12-21T08:30:31.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6532024-12-21T08:30:31.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6542024-12-21T08:30:31.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
6552024-12-21T08:30:31.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6562024-12-21T08:30:31.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6572024-12-21T08:30:31.552ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
6582024-12-21T08:30:31.552ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.854661ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
6592024-12-21T08:30:31.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.986033ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6602024-12-21T08:30:32.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f8fd9fee-2fbe-4fdb-99e2-097f236c8df9 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6612024-12-21T08:30:32.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f8fd9fee-2fbe-4fdb-99e2-097f236c8df9 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6622024-12-21T08:30:32.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f8fd9fee-2fbe-4fdb-99e2-097f236c8df9 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6632024-12-21T08:30:32.496ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a228df23-9207-434c-917e-97e43676157c remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e63c089a-d958-4f59-bacd-29a647a0e6c1 uri = /vmms/a228df23-9207-434c-917e-97e43676157c vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T08:30:32.488050701Z }
6642024-12-21T08:30:32.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e63c089a-d958-4f59-bacd-29a647a0e6c1 roles = RoleSet { roles: {} } uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6652024-12-21T08:30:32.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e63c089a-d958-4f59-bacd-29a647a0e6c1 resource = Database result = Ok(()) uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6662024-12-21T08:30:32.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33647 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e63c089a-d958-4f59-bacd-29a647a0e6c1 response_code = 204 uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6672024-12-21T08:30:32.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = 705c172d-0a04-4bfa-85ad-6b896eece8b0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
6682024-12-21T08:30:32.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = 705c172d-0a04-4bfa-85ad-6b896eece8b0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
6692024-12-21T08:30:32.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = 705c172d-0a04-4bfa-85ad-6b896eece8b0 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
6702024-12-21T08:30:32.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = cc3bbc73-fcb6-418b-bcb0-43783461cad9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
6712024-12-21T08:30:32.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = cc3bbc73-fcb6-418b-bcb0-43783461cad9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
6722024-12-21T08:30:32.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2867 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = cc3bbc73-fcb6-418b-bcb0-43783461cad9 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
6732024-12-21T08:30:33.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f7a73659-202c-4443-8365-0a760401e05c roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6742024-12-21T08:30:33.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f7a73659-202c-4443-8365-0a760401e05c resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6752024-12-21T08:30:33.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f7a73659-202c-4443-8365-0a760401e05c response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6762024-12-21T08:30:34.531ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1556 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = 6ee1a783-5b38-472e-aba0-68252fb956f2 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
6772024-12-21T08:30:34.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3dc482ef-34fe-412e-ac77-8c9196f1e402 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6782024-12-21T08:30:34.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3dc482ef-34fe-412e-ac77-8c9196f1e402 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6792024-12-21T08:30:34.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3dc482ef-34fe-412e-ac77-8c9196f1e402 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
6802024-12-21T08:30:34.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = b3e036ab-b9ff-4920-9a03-c8ffbc06756d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
6812024-12-21T08:30:34.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = b3e036ab-b9ff-4920-9a03-c8ffbc06756d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
6822024-12-21T08:30:34.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = b3e036ab-b9ff-4920-9a03-c8ffbc06756d response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
6832024-12-21T08:30:34.943ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a228df23-9207-434c-917e-97e43676157c remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 uri = /vmms/a228df23-9207-434c-917e-97e43676157c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T08:30:34.942762971Z }
6842024-12-21T08:30:34.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 roles = RoleSet { roles: {} } uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6852024-12-21T08:30:34.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 resource = Database result = Ok(()) uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6862024-12-21T08:30:34.955ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = a228df23-9207-434c-917e-97e43676157c remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 uri = /vmms/a228df23-9207-434c-917e-97e43676157c vmm_needs_update = true
6872024-12-21T08:30:34.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 roles = RoleSet { roles: {} } uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6882024-12-21T08:30:34.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 resource = Database result = Ok(()) uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6892024-12-21T08:30:34.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 roles = RoleSet { roles: {} } uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6902024-12-21T08:30:34.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 resource = Database result = Ok(()) uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6912024-12-21T08:30:34.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 roles = RoleSet { roles: {} } uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6922024-12-21T08:30:34.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 resource = Database result = Ok(()) uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6932024-12-21T08:30:34.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 roles = RoleSet { roles: {} } uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6942024-12-21T08:30:34.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 resource = Database result = Ok(()) uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6952024-12-21T08:30:34.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 roles = RoleSet { roles: {} } uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6962024-12-21T08:30:34.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 resource = Database result = Ok(()) uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6972024-12-21T08:30:34.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 roles = RoleSet { roles: {} } uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6982024-12-21T08:30:34.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 resource = Database result = Ok(()) uri = /vmms/a228df23-9207-434c-917e-97e43676157c
6992024-12-21T08:30:34.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/a228df23-9207-434c-917e-97e43676157c
7002024-12-21T08:30:34.969ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 36ce767e-8d13-48fc-b54f-25a543752b28, lookup_type: ById(36ce767e-8d13-48fc-b54f-25a543752b28) }, key: 1009ab7d-ffd9-407a-ac31-0cd04694fc56, lookup_type: ById(1009ab7d-ffd9-407a-ac31-0cd04694fc56) }, key: ed7e5504-1095-4d5f-8d41-92548098bd5c, lookup_type: ById(ed7e5504-1095-4d5f-8d41-92548098bd5c) } result = Ok(()) uri = /vmms/a228df23-9207-434c-917e-97e43676157c
7012024-12-21T08:30:34.969ZINFOnexus (dropshot_internal): starting update saga for ed7e5504-1095-4d5f-8d41-92548098bd5c actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1544 instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 uri = /vmms/a228df23-9207-434c-917e-97e43676157c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T08:30:34.942762971Z }
7022024-12-21T08:30:34.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26720 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 response_code = 204 uri = /vmms/a228df23-9207-434c-917e-97e43676157c
7032024-12-21T08:30:34.969ZDEBGnexus (dropshot_internal): preparing instance-update saga for ed7e5504-1095-4d5f-8d41-92548098bd5c... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09a7b243-4d9f-45ac-a08d-63d664a760f7 uri = /vmms/a228df23-9207-434c-917e-97e43676157c
7042024-12-21T08:30:34.969ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update
7052024-12-21T08:30:34.969ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"ed7e5504-1095-4d5f-8d41-92548098bd5c","lookup_type":{"ById":"ed7e5504-1095-4d5f-8d41-92548098bd5c"},"parent":{"key":"1009ab7d-ffd9-407a-ac31-0cd04694fc56","lookup_type":{"ById":"1009ab7d-ffd9-407a-ac31-0cd04694fc56"},"parent":{"key":"36ce767e-8d13-48fc-b54f-25a543752b28","lookup_type":{"ById":"36ce767e-8d13-48fc-b54f-25a543752b28"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7062024-12-21T08:30:34.969ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update
7072024-12-21T08:30:34.970ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a228df23-9207-434c-917e-97e43676157c remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3530ea82-5b4a-448d-ace5-aa98426dc2b8 uri = /vmms/a228df23-9207-434c-917e-97e43676157c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T08:30:34.942762971Z }
7082024-12-21T08:30:34.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3530ea82-5b4a-448d-ace5-aa98426dc2b8 roles = RoleSet { roles: {} } uri = /vmms/a228df23-9207-434c-917e-97e43676157c
7092024-12-21T08:30:34.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3530ea82-5b4a-448d-ace5-aa98426dc2b8 resource = Database result = Ok(()) uri = /vmms/a228df23-9207-434c-917e-97e43676157c
7102024-12-21T08:30:34.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7880 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3530ea82-5b4a-448d-ace5-aa98426dc2b8 response_code = 204 uri = /vmms/a228df23-9207-434c-917e-97e43676157c
7112024-12-21T08:30:35.006ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update
7122024-12-21T08:30:35.006ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7132024-12-21T08:30:35.006ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7142024-12-21T08:30:35.006ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65
7152024-12-21T08:30:35.012ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7162024-12-21T08:30:35.012ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65
7172024-12-21T08:30:35.017ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7182024-12-21T08:30:35.017ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65
7192024-12-21T08:30:35.021ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7202024-12-21T08:30:35.021ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("cefa03f7-2a96-4701-a6c6-db3aecdae32f")) node_id = 0 saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65
7212024-12-21T08:30:35.026ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7222024-12-21T08:30:35.026ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65
7232024-12-21T08:30:35.032ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update
7242024-12-21T08:30:35.032ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7252024-12-21T08:30:35.032ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7262024-12-21T08:30:35.034ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7272024-12-21T08:30:35.034ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7282024-12-21T08:30:35.035ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7292024-12-21T08:30:35.035ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7302024-12-21T08:30:35.037ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7312024-12-21T08:30:35.037ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7322024-12-21T08:30:35.039ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7332024-12-21T08:30:35.039ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7342024-12-21T08:30:35.040ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7352024-12-21T08:30:35.041ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7362024-12-21T08:30:35.042ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7372024-12-21T08:30:35.045ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 36ce767e-8d13-48fc-b54f-25a543752b28, lookup_type: ById(36ce767e-8d13-48fc-b54f-25a543752b28) }, key: 1009ab7d-ffd9-407a-ac31-0cd04694fc56, lookup_type: ById(1009ab7d-ffd9-407a-ac31-0cd04694fc56) }, key: ed7e5504-1095-4d5f-8d41-92548098bd5c, lookup_type: ById(ed7e5504-1095-4d5f-8d41-92548098bd5c) } result = Ok(()) saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7382024-12-21T08:30:35.045ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance updater_id = cefa03f7-2a96-4701-a6c6-db3aecdae32f
7392024-12-21T08:30:35.045ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7402024-12-21T08:30:35.045ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7412024-12-21T08:30:35.056ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance updater_id = cefa03f7-2a96-4701-a6c6-db3aecdae32f
7422024-12-21T08:30:35.056ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7432024-12-21T08:30:35.056ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance
7442024-12-21T08:30:35.063ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c locked_gen = Generation(Generation(2)) saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = LockInstance updater_id = cefa03f7-2a96-4701-a6c6-db3aecdae32f
7452024-12-21T08:30:35.063ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7462024-12-21T08:30:35.063ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("cefa03f7-2a96-4701-a6c6-db3aecdae32f")}) node_id = 1 saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65
7472024-12-21T08:30:35.067ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7482024-12-21T08:30:35.067ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65
7492024-12-21T08:30:35.070ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
7502024-12-21T08:30:35.070ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
7512024-12-21T08:30:35.076ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
7522024-12-21T08:30:35.077ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
7532024-12-21T08:30:35.078ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
7542024-12-21T08:30:35.078ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
7552024-12-21T08:30:35.080ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
7562024-12-21T08:30:35.083ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 36ce767e-8d13-48fc-b54f-25a543752b28, lookup_type: ById(36ce767e-8d13-48fc-b54f-25a543752b28) }, key: 1009ab7d-ffd9-407a-ac31-0cd04694fc56, lookup_type: ById(1009ab7d-ffd9-407a-ac31-0cd04694fc56) }, key: ed7e5504-1095-4d5f-8d41-92548098bd5c, lookup_type: ById(ed7e5504-1095-4d5f-8d41-92548098bd5c) } result = Ok(()) saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
7572024-12-21T08:30:35.083ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
7582024-12-21T08:30:35.083ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
7592024-12-21T08:30:35.089ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: a228df23-9207-434c-917e-97e43676157c, time_created: 2024-12-21T08:30:14.238269Z, time_deleted: None, instance_id: ed7e5504-1095-4d5f-8d41-92548098bd5c, sled_id: 3b53ba2d-4d00-44a6-bd37-8306adc194ea, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-21T08:30:34.942762Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-21T08:30:11.967847Z, gen: Generation(Generation(3)), propolis_id: Some(a228df23-9207-434c-917e-97e43676157c), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(a228df23-9207-434c-917e-97e43676157c (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-21T08:30:35.089446735Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
7602024-12-21T08:30:35.094ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
7612024-12-21T08:30:35.094ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"ed7e5504-1095-4d5f-8d41-92548098bd5c","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"a228df23-9207-434c-917e-97e43676157c"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"ed7e5504-1095-4d5f-8d41-92548098bd5c","lookup_type":{"ById":"ed7e5504-1095-4d5f-8d41-92548098bd5c"},"parent":{"key":"1009ab7d-ffd9-407a-ac31-0cd04694fc56","lookup_type":{"ById":"1009ab7d-ffd9-407a-ac31-0cd04694fc56"},"parent":{"key":"36ce767e-8d13-48fc-b54f-25a543752b28","lookup_type":{"ById":"36ce767e-8d13-48fc-b54f-25a543752b28"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"cefa03f7-2a96-4701-a6c6-db3aecdae32f"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"1009ab7d-ffd9-407a-ac31-0cd04694fc56","ram_diff":1073741824},"destroy_active_vmm":"a228df23-9207-434c-917e-97e43676157c","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-21T08:30:35.089446735Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7622024-12-21T08:30:35.094ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
7632024-12-21T08:30:35.125ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
7642024-12-21T08:30:35.125ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7652024-12-21T08:30:35.125ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7662024-12-21T08:30:35.125ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
7672024-12-21T08:30:35.129ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7682024-12-21T08:30:35.129ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
7692024-12-21T08:30:35.132ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7702024-12-21T08:30:35.132ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
7712024-12-21T08:30:35.135ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7722024-12-21T08:30:35.135ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("7aececc9-192f-4ea6-b572-3b2751b626f1")) node_id = 0 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
7732024-12-21T08:30:35.138ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7742024-12-21T08:30:35.138ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
7752024-12-21T08:30:35.141ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c parent_lock = UpdaterLock { updater_id: cefa03f7-2a96-4701-a6c6-db3aecdae32f, locked_gen: Generation(Generation(2)) } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
7762024-12-21T08:30:35.141ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = BecomeUpdater
7772024-12-21T08:30:35.142ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = BecomeUpdater
7782024-12-21T08:30:35.150ZDEBGnexus (SagaExecutor): inherited lock from cefa03f7-2a96-4701-a6c6-db3aecdae32f to 7aececc9-192f-4ea6-b572-3b2751b626f1 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = cefa03f7-2a96-4701-a6c6-db3aecdae32f saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = BecomeUpdater updater_id = 7aececc9-192f-4ea6-b572-3b2751b626f1
7792024-12-21T08:30:35.150ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
7802024-12-21T08:30:35.150ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7812024-12-21T08:30:35.150ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("7aececc9-192f-4ea6-b572-3b2751b626f1")}) node_id = 1 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
7822024-12-21T08:30:35.153ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7832024-12-21T08:30:35.153ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
7842024-12-21T08:30:35.156ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7852024-12-21T08:30:35.156ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
7862024-12-21T08:30:35.159ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
7872024-12-21T08:30:35.159ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
7882024-12-21T08:30:35.162ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
7892024-12-21T08:30:35.162ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c
7902024-12-21T08:30:35.165ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = UpdateNetworkConfig
7912024-12-21T08:30:35.165ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = UpdateNetworkConfig
7922024-12-21T08:30:35.168ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = UpdateNetworkConfig
7932024-12-21T08:30:35.168ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = UpdateNetworkConfig
7942024-12-21T08:30:35.170ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
7952024-12-21T08:30:35.170ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = UpdateNetworkConfig
7962024-12-21T08:30:35.170ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = UpdateNetworkConfig
7972024-12-21T08:30:35.172ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
7982024-12-21T08:30:35.172ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
7992024-12-21T08:30:35.173ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
8002024-12-21T08:30:35.174ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
8012024-12-21T08:30:35.175ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
8022024-12-21T08:30:35.175ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
8032024-12-21T08:30:35.175ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
8042024-12-21T08:30:35.180ZDEBGnexus: notifying dendrite of updates instance_id = Some(ed7e5504-1095-4d5f-8d41-92548098bd5c (instance)) switch = switch0
8052024-12-21T08:30:35.180ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1717, tv_nsec: 170217246 } })
8062024-12-21T08:30:35.180ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
8072024-12-21T08:30:35.211ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
8082024-12-21T08:30:35.211ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8092024-12-21T08:30:35.212ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "23fe066f-f7b1-4f22-8467-b1c58bd36f3b", "content-length": "26", "date": "Sat, 21 Dec 2024 08:30:34 GMT"} })
8102024-12-21T08:30:35.212ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8112024-12-21T08:30:35.212ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8122024-12-21T08:30:35.242ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
8132024-12-21T08:30:35.242ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c441626-d146-482b-8e16-1fc6c864f591", "content-length": "4", "date": "Sat, 21 Dec 2024 08:30:34 GMT"} })
8142024-12-21T08:30:35.243ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8152024-12-21T08:30:35.243ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8162024-12-21T08:30:35.247ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8172024-12-21T08:30:35.247ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8182024-12-21T08:30:35.250ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
8192024-12-21T08:30:35.250ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
8202024-12-21T08:30:35.264ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-21T08:30:35.253577Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 1009ab7d-ffd9-407a-ac31-0cd04694fc56, time_modified: Some(2024-12-21T08:30:35.253577Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 36ce767e-8d13-48fc-b54f-25a543752b28, time_modified: Some(2024-12-21T08:30:35.253577Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
8212024-12-21T08:30:35.267ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8222024-12-21T08:30:35.267ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8232024-12-21T08:30:35.270ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8242024-12-21T08:30:35.270ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8252024-12-21T08:30:35.275ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
8262024-12-21T08:30:35.275ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = UnassignOximeterProducer
8272024-12-21T08:30:35.275ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = UnassignOximeterProducer
8282024-12-21T08:30:35.279ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = d3e17b73-750a-4d54-b6e9-cb13b0984ebb producer_id = ed7e5504-1095-4d5f-8d41-92548098bd5c saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
8292024-12-21T08:30:35.279ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = UnassignOximeterProducer
8302024-12-21T08:30:35.279ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = UnassignOximeterProducer
8312024-12-21T08:30:35.316ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = ed7e5504-1095-4d5f-8d41-92548098bd5c saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
8322024-12-21T08:30:35.319ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = ed7e5504-1095-4d5f-8d41-92548098bd5c saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/ed7e5504-1095-4d5f-8d41-92548098bd5c
8332024-12-21T08:30:35.338ZDEBGnexus (SagaExecutor): client response oximeter-collector = ed7e5504-1095-4d5f-8d41-92548098bd5c result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/ed7e5504-1095-4d5f-8d41-92548098bd5c", status: 204, headers: {"x-request-id": "ff9b83c1-7160-4345-8e24-8ed275989ff3", "date": "Sat, 21 Dec 2024 08:30:35 GMT"} }) saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
8342024-12-21T08:30:35.338ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = d3e17b73-750a-4d54-b6e9-cb13b0984ebb producer_id = ed7e5504-1095-4d5f-8d41-92548098bd5c saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
8352024-12-21T08:30:35.339ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8362024-12-21T08:30:35.339ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8372024-12-21T08:30:35.343ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8382024-12-21T08:30:35.343ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8392024-12-21T08:30:35.346ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c lock = UpdaterLock { updater_id: 7aececc9-192f-4ea6-b572-3b2751b626f1, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-21T08:30:35.089446735Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
8402024-12-21T08:30:35.346ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = CommitInstanceUpdates
8412024-12-21T08:30:35.347ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = CommitInstanceUpdates
8422024-12-21T08:30:35.383ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c new_runtime = InstanceRuntimeState { time_updated: 2024-12-21T08:30:35.089446735Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
8432024-12-21T08:30:35.383ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8442024-12-21T08:30:35.383ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8452024-12-21T08:30:35.383ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
8462024-12-21T08:30:35.383ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
8472024-12-21T08:30:35.383ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
8482024-12-21T08:30:35.383ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8492024-12-21T08:30:35.383ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8502024-12-21T08:30:35.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8512024-12-21T08:30:35.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8522024-12-21T08:30:35.385ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8532024-12-21T08:30:35.386ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8542024-12-21T08:30:35.386ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8552024-12-21T08:30:35.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8562024-12-21T08:30:35.387ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8572024-12-21T08:30:35.387ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8582024-12-21T08:30:35.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8592024-12-21T08:30:35.389ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8602024-12-21T08:30:35.389ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8612024-12-21T08:30:35.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8622024-12-21T08:30:35.391ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8632024-12-21T08:30:35.391ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("ed7e5504-1095-4d5f-8d41-92548098bd5c"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("a228df23-9207-434c-917e-97e43676157c")}) node_id = 7 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8642024-12-21T08:30:35.395ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8652024-12-21T08:30:35.395ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8662024-12-21T08:30:35.397ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8672024-12-21T08:30:35.397ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8682024-12-21T08:30:35.401ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8692024-12-21T08:30:35.401ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8702024-12-21T08:30:35.406ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c propolis_id = a228df23-9207-434c-917e-97e43676157c saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
8712024-12-21T08:30:35.406ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = ReleaseSledResources
8722024-12-21T08:30:35.406ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = ReleaseSledResources
8732024-12-21T08:30:35.416ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8742024-12-21T08:30:35.416ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8752024-12-21T08:30:35.420ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8762024-12-21T08:30:35.420ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8772024-12-21T08:30:35.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8782024-12-21T08:30:35.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8792024-12-21T08:30:35.423ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c propolis_id = a228df23-9207-434c-917e-97e43676157c saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
8802024-12-21T08:30:35.423ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = MarkVmmDeleted
8812024-12-21T08:30:35.423ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = MarkVmmDeleted
8822024-12-21T08:30:35.431ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8832024-12-21T08:30:35.431ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8842024-12-21T08:30:35.434ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8852024-12-21T08:30:35.434ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8862024-12-21T08:30:35.439ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8872024-12-21T08:30:35.439ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8882024-12-21T08:30:35.443ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
8892024-12-21T08:30:35.443ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
8902024-12-21T08:30:35.447ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = ChainSuccessorSaga
8912024-12-21T08:30:35.447ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = ChainSuccessorSaga
8922024-12-21T08:30:35.449ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = ChainSuccessorSaga
8932024-12-21T08:30:35.449ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = ChainSuccessorSaga
8942024-12-21T08:30:35.450ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = ChainSuccessorSaga
8952024-12-21T08:30:35.450ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = ChainSuccessorSaga
8962024-12-21T08:30:35.452ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = ChainSuccessorSaga
8972024-12-21T08:30:35.455ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 36ce767e-8d13-48fc-b54f-25a543752b28, lookup_type: ById(36ce767e-8d13-48fc-b54f-25a543752b28) }, key: 1009ab7d-ffd9-407a-ac31-0cd04694fc56, lookup_type: ById(1009ab7d-ffd9-407a-ac31-0cd04694fc56) }, key: ed7e5504-1095-4d5f-8d41-92548098bd5c, lookup_type: ById(ed7e5504-1095-4d5f-8d41-92548098bd5c) } result = Ok(()) saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = ChainSuccessorSaga
8982024-12-21T08:30:35.455ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = ChainSuccessorSaga
8992024-12-21T08:30:35.455ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_node = ChainSuccessorSaga
9002024-12-21T08:30:35.480ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
9012024-12-21T08:30:35.480ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9022024-12-21T08:30:35.480ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dcc9fe1-0480-4b7f-9558-977eb065fa9a", "content-length": "372", "date": "Sat, 21 Dec 2024 08:30:35 GMT"} })
9032024-12-21T08:30:35.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9042024-12-21T08:30:35.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9052024-12-21T08:30:35.483ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9062024-12-21T08:30:35.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9072024-12-21T08:30:35.485ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9082024-12-21T08:30:35.487ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9092024-12-21T08:30:35.487ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9102024-12-21T08:30:35.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9112024-12-21T08:30:35.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9122024-12-21T08:30:35.489ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9132024-12-21T08:30:35.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9142024-12-21T08:30:35.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9152024-12-21T08:30:35.494ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
9162024-12-21T08:30:35.494ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
9172024-12-21T08:30:35.495ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e6fb8153-8d1b-4992-a6da-666e4ab9daec", "date": "Sat, 21 Dec 2024 08:30:35 GMT"} })
9182024-12-21T08:30:35.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9192024-12-21T08:30:35.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9202024-12-21T08:30:35.497ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9212024-12-21T08:30:35.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9222024-12-21T08:30:35.500ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9232024-12-21T08:30:35.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9242024-12-21T08:30:35.503ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
9252024-12-21T08:30:35.503ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9262024-12-21T08:30:35.503ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2e0dd27f-9e76-4125-8565-8fcc9ecfc25c", "date": "Sat, 21 Dec 2024 08:30:35 GMT"} })
9272024-12-21T08:30:35.506ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 122.964505ms iteration = 27 status = {}
9282024-12-21T08:30:35.513ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update
9292024-12-21T08:30:35.513ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
9302024-12-21T08:30:35.513ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
9312024-12-21T08:30:35.513ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Signaled
9322024-12-21T08:30:35.513ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9332024-12-21T08:30:35.513ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9342024-12-21T08:30:35.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9352024-12-21T08:30:35.516ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
9362024-12-21T08:30:35.516ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
9372024-12-21T08:30:35.524ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
9382024-12-21T08:30:35.524ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "34c209f6-2b5d-4266-a6c7-04b00cbf2953", "content-length": "691", "date": "Sat, 21 Dec 2024 08:30:35 GMT"} })
9392024-12-21T08:30:35.524ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
9402024-12-21T08:30:35.524ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
9412024-12-21T08:30:35.524ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
9422024-12-21T08:30:35.526ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 143.737298ms iteration = 26 status = {}
9432024-12-21T08:30:35.528ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
9442024-12-21T08:30:35.528ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
9452024-12-21T08:30:35.532ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
9462024-12-21T08:30:35.532ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18
9472024-12-21T08:30:35.539ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
9482024-12-21T08:30:35.539ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 saga_name = instance-update saga_result = SagaResult { saga_id: 4d989080-ed60-4aab-94c8-68db33d5de18, saga_log: SagaLog { saga_id: 4d989080-ed60-4aab-94c8-68db33d5de18, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("7aececc9-192f-4ea6-b572-3b2751b626f1")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("7aececc9-192f-4ea6-b572-3b2751b626f1")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("ed7e5504-1095-4d5f-8d41-92548098bd5c"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("a228df23-9207-434c-917e-97e43676157c")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("ed7e5504-1095-4d5f-8d41-92548098bd5c"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("a228df23-9207-434c-917e-97e43676157c")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("7aececc9-192f-4ea6-b572-3b2751b626f1"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("7aececc9-192f-4ea6-b572-3b2751b626f1")}} }) }
9492024-12-21T08:30:35.539ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 4d989080-ed60-4aab-94c8-68db33d5de18 instance_id = ed7e5504-1095-4d5f-8d41-92548098bd5c saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update
9502024-12-21T08:30:35.539ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
9512024-12-21T08:30:35.539ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65
9522024-12-21T08:30:35.544ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
9532024-12-21T08:30:35.544ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65
9542024-12-21T08:30:35.546ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
9552024-12-21T08:30:35.546ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65
9562024-12-21T08:30:35.549ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
9572024-12-21T08:30:35.549ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65
9582024-12-21T08:30:35.555ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9592024-12-21T08:30:35.555ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
9602024-12-21T08:30:35.555ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9612024-12-21T08:30:35.555ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update sec_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
9622024-12-21T08:30:35.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9632024-12-21T08:30:35.555ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65 saga_name = start-instance-update saga_result = SagaResult { saga_id: 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65, saga_log: SagaLog { saga_id: 43cba3c8-6cc6-4b50-8f5a-94e79cccfe65, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("cefa03f7-2a96-4701-a6c6-db3aecdae32f")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("cefa03f7-2a96-4701-a6c6-db3aecdae32f")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("cefa03f7-2a96-4701-a6c6-db3aecdae32f"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("cefa03f7-2a96-4701-a6c6-db3aecdae32f")}} }) }
9642024-12-21T08:30:35.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 50108416-5429-420e-948f-3e52701378c8 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9652024-12-21T08:30:35.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 50108416-5429-420e-948f-3e52701378c8 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9662024-12-21T08:30:35.557ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9672024-12-21T08:30:35.557ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
9682024-12-21T08:30:35.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9692024-12-21T08:30:35.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9702024-12-21T08:30:35.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1522 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 50108416-5429-420e-948f-3e52701378c8 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9712024-12-21T08:30:35.586ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9722024-12-21T08:30:35.586ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
9732024-12-21T08:30:35.586ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 73.569869ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
9742024-12-21T08:30:35.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = 407f2573-39d3-47c4-9f8f-98d10c28ef60 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
9752024-12-21T08:30:35.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = 407f2573-39d3-47c4-9f8f-98d10c28ef60 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
9762024-12-21T08:30:35.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = 407f2573-39d3-47c4-9f8f-98d10c28ef60 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
9772024-12-21T08:30:36.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = de24ff18-9e45-4edd-9625-905f0159c572 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9782024-12-21T08:30:36.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = de24ff18-9e45-4edd-9625-905f0159c572 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9792024-12-21T08:30:36.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = de24ff18-9e45-4edd-9625-905f0159c572 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9802024-12-21T08:30:37.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 95d1241c-d6db-431f-b61b-9cb5f77971c5 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9812024-12-21T08:30:37.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 95d1241c-d6db-431f-b61b-9cb5f77971c5 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9822024-12-21T08:30:37.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 95d1241c-d6db-431f-b61b-9cb5f77971c5 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9832024-12-21T08:30:38.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 5675230a-10cd-4a3f-8576-a2a4091e939f roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9842024-12-21T08:30:38.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 5675230a-10cd-4a3f-8576-a2a4091e939f resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9852024-12-21T08:30:38.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 5675230a-10cd-4a3f-8576-a2a4091e939f response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9862024-12-21T08:30:39.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 35fbc7f1-17aa-427c-97c3-30b2a9e5ce3b roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9872024-12-21T08:30:39.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 35fbc7f1-17aa-427c-97c3-30b2a9e5ce3b resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9882024-12-21T08:30:39.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 35fbc7f1-17aa-427c-97c3-30b2a9e5ce3b response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9892024-12-21T08:30:40.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3bc32115-faf7-418a-b121-2b8b89480f79 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9902024-12-21T08:30:40.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3bc32115-faf7-418a-b121-2b8b89480f79 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9912024-12-21T08:30:40.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3bc32115-faf7-418a-b121-2b8b89480f79 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
9922024-12-21T08:30:41.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
9932024-12-21T08:30:41.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
9942024-12-21T08:30:41.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9952024-12-21T08:30:41.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9962024-12-21T08:30:41.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9972024-12-21T08:30:41.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9982024-12-21T08:30:41.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9992024-12-21T08:30:41.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10002024-12-21T08:30:41.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10012024-12-21T08:30:41.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.4796ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10022024-12-21T08:30:41.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10032024-12-21T08:30:41.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10042024-12-21T08:30:41.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10052024-12-21T08:30:41.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10062024-12-21T08:30:41.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10072024-12-21T08:30:41.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10082024-12-21T08:30:41.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
10092024-12-21T08:30:41.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10102024-12-21T08:30:41.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10112024-12-21T08:30:41.549ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
10122024-12-21T08:30:41.549ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.869525ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
10132024-12-21T08:30:41.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 92b3161f-0c46-447b-ae66-ffc75aeafea8 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10142024-12-21T08:30:41.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 92b3161f-0c46-447b-ae66-ffc75aeafea8 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10152024-12-21T08:30:41.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 92b3161f-0c46-447b-ae66-ffc75aeafea8 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10162024-12-21T08:30:42.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 1b622b75-75a7-47bd-8a1c-125ac2cad0a5 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10172024-12-21T08:30:42.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 1b622b75-75a7-47bd-8a1c-125ac2cad0a5 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10182024-12-21T08:30:42.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 1b622b75-75a7-47bd-8a1c-125ac2cad0a5 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10192024-12-21T08:30:43.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f9601757-d0c6-4acf-98aa-399a35b760b7 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10202024-12-21T08:30:43.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f9601757-d0c6-4acf-98aa-399a35b760b7 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10212024-12-21T08:30:43.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f9601757-d0c6-4acf-98aa-399a35b760b7 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10222024-12-21T08:30:44.531ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1496 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = 51dbda60-c9b1-4381-9914-a69b482235b6 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
10232024-12-21T08:30:44.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a5c74b68-7072-4c18-a712-4fa0a8f8c54b roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10242024-12-21T08:30:44.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a5c74b68-7072-4c18-a712-4fa0a8f8c54b resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10252024-12-21T08:30:44.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a5c74b68-7072-4c18-a712-4fa0a8f8c54b response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10262024-12-21T08:30:45.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7055c936-b73d-420b-9500-520ae8f45f0c roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10272024-12-21T08:30:45.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7055c936-b73d-420b-9500-520ae8f45f0c resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10282024-12-21T08:30:45.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7055c936-b73d-420b-9500-520ae8f45f0c response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10292024-12-21T08:30:46.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 96823bfa-e996-4c67-9155-e34496829653 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10302024-12-21T08:30:46.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 96823bfa-e996-4c67-9155-e34496829653 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10312024-12-21T08:30:46.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 96823bfa-e996-4c67-9155-e34496829653 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10322024-12-21T08:30:47.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 79b09638-00eb-4e2f-9369-acd115d60b26 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10332024-12-21T08:30:47.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 79b09638-00eb-4e2f-9369-acd115d60b26 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10342024-12-21T08:30:47.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 79b09638-00eb-4e2f-9369-acd115d60b26 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10352024-12-21T08:30:48.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c3bf9753-0b10-4018-8847-e61b03222f29 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10362024-12-21T08:30:48.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c3bf9753-0b10-4018-8847-e61b03222f29 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10372024-12-21T08:30:48.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c3bf9753-0b10-4018-8847-e61b03222f29 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10382024-12-21T08:30:49.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a1bb61a8-708c-4db1-83ec-d0bd1608e18f roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10392024-12-21T08:30:49.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a1bb61a8-708c-4db1-83ec-d0bd1608e18f resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10402024-12-21T08:30:49.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2773 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a1bb61a8-708c-4db1-83ec-d0bd1608e18f response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10412024-12-21T08:30:50.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a5e0d135-326b-4a46-9ff2-a3e024b2111d roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10422024-12-21T08:30:50.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a5e0d135-326b-4a46-9ff2-a3e024b2111d resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10432024-12-21T08:30:50.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a5e0d135-326b-4a46-9ff2-a3e024b2111d response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
10442024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
10452024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
10462024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10472024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
10482024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10492024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
10502024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
10512024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10522024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
10532024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10542024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10552024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10562024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
10572024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10582024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
10592024-12-21T08:30:51.530ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10602024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
10612024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10622024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
10632024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10642024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10652024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
10662024-12-21T08:30:51.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10672024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
10682024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
10692024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10702024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10712024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
10722024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10732024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
10742024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10752024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
10762024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10772024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
10782024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10792024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10802024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10812024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10822024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10832024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10842024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10852024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10862024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10872024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10882024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10892024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10902024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10912024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10922024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10932024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10942024-12-21T08:30:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10952024-12-21T08:30:51.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10962024-12-21T08:30:51.533ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.30156ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10972024-12-21T08:30:51.534ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1733, tv_nsec: 524029126 } })
10982024-12-21T08:30:51.534ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10992024-12-21T08:30:51.534ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11002024-12-21T08:30:51.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11012024-12-21T08:30:51.535ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
11022024-12-21T08:30:51.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11032024-12-21T08:30:51.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11042024-12-21T08:30:51.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11052024-12-21T08:30:51.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11062024-12-21T08:30:51.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11072024-12-21T08:30:51.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11082024-12-21T08:30:51.537ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11092024-12-21T08:30:51.538ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11102024-12-21T08:30:51.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11112024-12-21T08:30:51.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11122024-12-21T08:30:51.538ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11132024-12-21T08:30:51.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11142024-12-21T08:30:51.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11152024-12-21T08:30:51.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11162024-12-21T08:30:51.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11172024-12-21T08:30:51.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11182024-12-21T08:30:51.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11192024-12-21T08:30:51.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11202024-12-21T08:30:51.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11212024-12-21T08:30:51.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11222024-12-21T08:30:51.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11232024-12-21T08:30:51.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11242024-12-21T08:30:51.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11252024-12-21T08:30:51.542ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1733, tv_nsec: 531795105 } })
11262024-12-21T08:30:51.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11272024-12-21T08:30:51.542ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
11282024-12-21T08:30:51.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11292024-12-21T08:30:51.544ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11302024-12-21T08:30:51.544ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11312024-12-21T08:30:51.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11322024-12-21T08:30:51.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11332024-12-21T08:30:51.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11342024-12-21T08:30:51.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11352024-12-21T08:30:51.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11362024-12-21T08:30:51.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11372024-12-21T08:30:51.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11382024-12-21T08:30:51.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11392024-12-21T08:30:51.547ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11402024-12-21T08:30:51.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11412024-12-21T08:30:51.548ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11422024-12-21T08:30:51.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11432024-12-21T08:30:51.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11442024-12-21T08:30:51.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11452024-12-21T08:30:51.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11462024-12-21T08:30:51.559ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1733, tv_nsec: 549091177 } })
11472024-12-21T08:30:51.560ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
11482024-12-21T08:30:51.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 41.248304ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
11492024-12-21T08:30:51.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11502024-12-21T08:30:51.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11512024-12-21T08:30:51.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11522024-12-21T08:30:51.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11532024-12-21T08:30:51.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11542024-12-21T08:30:51.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11552024-12-21T08:30:51.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11562024-12-21T08:30:51.585ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 54.250029ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11572024-12-21T08:30:51.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11582024-12-21T08:30:51.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.6143ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
11592024-12-21T08:30:51.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11602024-12-21T08:30:51.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3b53ba2d-4d00-44a6-bd37-8306adc194ea, lookup_type: ById(3b53ba2d-4d00-44a6-bd37-8306adc194ea) } result = Ok(())
11612024-12-21T08:30:51.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11622024-12-21T08:30:51.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11632024-12-21T08:30:51.591ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 60.756776ms iteration = 26 status = 0
11642024-12-21T08:30:51.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11652024-12-21T08:30:51.592ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11662024-12-21T08:30:51.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11672024-12-21T08:30:51.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11682024-12-21T08:30:51.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
11692024-12-21T08:30:51.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11702024-12-21T08:30:51.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11712024-12-21T08:30:51.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11722024-12-21T08:30:51.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11732024-12-21T08:30:51.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11742024-12-21T08:30:51.598ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11752024-12-21T08:30:51.598ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11762024-12-21T08:30:51.598ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 67.584036ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11772024-12-21T08:30:51.599ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11782024-12-21T08:30:51.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11792024-12-21T08:30:51.600ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.594064ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11802024-12-21T08:30:51.605ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
11812024-12-21T08:30:51.605ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.436707ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
11822024-12-21T08:30:51.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11832024-12-21T08:30:51.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11842024-12-21T08:30:51.607ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11852024-12-21T08:30:51.607ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.133441ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
11862024-12-21T08:30:51.608ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11872024-12-21T08:30:51.609ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11882024-12-21T08:30:51.609ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11892024-12-21T08:30:51.609ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11902024-12-21T08:30:51.609ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11912024-12-21T08:30:51.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11922024-12-21T08:30:51.610ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4530527c-7b47-45ed-b522-97029adbf0f3", "content-length": "26", "date": "Sat, 21 Dec 2024 08:30:51 GMT"} })
11932024-12-21T08:30:51.610ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11942024-12-21T08:30:51.611ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11952024-12-21T08:30:51.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.199866ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11962024-12-21T08:30:51.612ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11972024-12-21T08:30:51.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11982024-12-21T08:30:51.613ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11992024-12-21T08:30:51.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12002024-12-21T08:30:51.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 91.296475ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
12012024-12-21T08:30:51.628ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
12022024-12-21T08:30:51.628ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12032024-12-21T08:30:51.628ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a076ba27-b555-4c04-97d8-371acea9ca8c", "content-length": "26", "date": "Sat, 21 Dec 2024 08:30:51 GMT"} })
12042024-12-21T08:30:51.628ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12052024-12-21T08:30:51.628ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 98.174386ms iteration = 30 status = {"physical_disks_added":0}
12062024-12-21T08:30:51.630ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12072024-12-21T08:30:51.660ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 zone_address = fd00:1122:3344:101::2
12082024-12-21T08:30:51.660ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12092024-12-21T08:30:51.660ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca009c16-c008-4c1e-a7d4-b3adcf3078d8", "content-length": "26", "date": "Sat, 21 Dec 2024 08:30:51 GMT"} })
12102024-12-21T08:30:51.660ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12112024-12-21T08:30:51.663ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
12122024-12-21T08:30:51.747ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12132024-12-21T08:30:51.747ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d403f314-bc46-45e9-99cb-2d390c0f1718", "content-length": "691", "date": "Sat, 21 Dec 2024 08:30:51 GMT"} })
12142024-12-21T08:30:51.747ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
12152024-12-21T08:30:51.747ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
12162024-12-21T08:30:51.747ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
12172024-12-21T08:30:51.750ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 219.800288ms iteration = 27 status = {}
12182024-12-21T08:30:51.753ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
12192024-12-21T08:30:51.753ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "663f69c5-7ea8-4070-a862-e4be6521aa62", "content-length": "2", "date": "Sat, 21 Dec 2024 08:30:51 GMT"} })
12202024-12-21T08:30:51.755ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12212024-12-21T08:30:51.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12222024-12-21T08:30:51.757ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 226.543338ms iteration = 26 status = null
12232024-12-21T08:30:51.764ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12242024-12-21T08:30:51.764ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12252024-12-21T08:30:51.765ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3181c19-bb94-44b3-abd3-8abb848d5be2", "content-length": "372", "date": "Sat, 21 Dec 2024 08:30:51 GMT"} })
12262024-12-21T08:30:51.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12272024-12-21T08:30:51.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12282024-12-21T08:30:51.767ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 236.272904ms iteration = 26 status = {}
12292024-12-21T08:30:51.778ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
12302024-12-21T08:30:51.778ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
12312024-12-21T08:30:51.778ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fc541f01-5dcd-46c5-bc5a-ad0ce346bbd0", "date": "Sat, 21 Dec 2024 08:30:51 GMT"} })
12322024-12-21T08:30:51.778ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12332024-12-21T08:30:51.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12342024-12-21T08:30:51.781ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12352024-12-21T08:30:51.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12362024-12-21T08:30:51.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12372024-12-21T08:30:51.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12382024-12-21T08:30:51.786ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
12392024-12-21T08:30:51.787ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12402024-12-21T08:30:51.787ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "51454410-085c-4f95-a27e-7199a2836494", "date": "Sat, 21 Dec 2024 08:30:51 GMT"} })
12412024-12-21T08:30:51.789ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 258.825663ms iteration = 28 status = {}
12422024-12-21T08:30:51.836ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12432024-12-21T08:30:51.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12442024-12-21T08:30:51.838ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4986737f-c249-4380-901f-c7ce67751b89, rack_id: dcff325a-cbfd-4a8c-805a-d5b8a1a42707, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a98489e0-d62f-4837-a1f0-df124db3049c) } rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0
12452024-12-21T08:30:51.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12462024-12-21T08:30:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12472024-12-21T08:30:51.848ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
12482024-12-21T08:30:51.848ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "64c9e5df-7173-42a5-8f0e-42a759d21f06", "content-length": "134", "date": "Sat, 21 Dec 2024 08:30:51 GMT"} })
12492024-12-21T08:30:51.848ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
12502024-12-21T08:30:51.848ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a98489e0-d62f-4837-a1f0-df124db3049c
12512024-12-21T08:30:51.848ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
12522024-12-21T08:30:51.848ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
12532024-12-21T08:30:51.848ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12542024-12-21T08:30:51.848ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12552024-12-21T08:30:51.848ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12562024-12-21T08:30:51.848ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12572024-12-21T08:30:51.849ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12582024-12-21T08:30:51.849ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12592024-12-21T08:30:51.849ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
12602024-12-21T08:30:51.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12612024-12-21T08:30:51.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12622024-12-21T08:30:51.851ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
12632024-12-21T08:30:51.851ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb60ee29-06ef-421e-9f54-6f5372079657", "content-length": "2", "date": "Sat, 21 Dec 2024 08:30:51 GMT"} })
12642024-12-21T08:30:51.851ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
12652024-12-21T08:30:51.851ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6415c61-3327-4894-a446-8922111c349a", "content-length": "52", "date": "Sat, 21 Dec 2024 08:30:51 GMT"} })
12662024-12-21T08:30:51.851ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0
12672024-12-21T08:30:51.851ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
12682024-12-21T08:30:51.978ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6ce61de2-dae8-4bf4-bb43-209bf78dd781", "date": "Sat, 21 Dec 2024 08:30:51 GMT"} })
12692024-12-21T08:30:51.979ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch = Switch0
12702024-12-21T08:30:51.979ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
12712024-12-21T08:30:51.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a297bb31-797d-49e2-aba8-d05776f00ce5 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
12722024-12-21T08:30:51.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a297bb31-797d-49e2-aba8-d05776f00ce5 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
12732024-12-21T08:30:51.979ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2718ea28-7eeb-421c-9bf5-17b537e1a859", "content-length": "682", "date": "Sat, 21 Dec 2024 08:30:51 GMT"} })
12742024-12-21T08:30:51.979ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12752024-12-21T08:30:51.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12762024-12-21T08:30:51.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a297bb31-797d-49e2-aba8-d05776f00ce5 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
12772024-12-21T08:30:51.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12782024-12-21T08:30:51.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12792024-12-21T08:30:51.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12802024-12-21T08:30:51.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12812024-12-21T08:30:51.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12822024-12-21T08:30:51.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12832024-12-21T08:30:51.995ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 464.846691ms iteration = 26 status = {}
12842024-12-21T08:30:53.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d1e8c78e-e824-4cc6-87d7-b76d9baafd51 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
12852024-12-21T08:30:53.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d1e8c78e-e824-4cc6-87d7-b76d9baafd51 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
12862024-12-21T08:30:53.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d1e8c78e-e824-4cc6-87d7-b76d9baafd51 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
12872024-12-21T08:30:54.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = fd3e34e0-9ed0-4ce0-a407-5eae1e218560 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
12882024-12-21T08:30:54.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = fd3e34e0-9ed0-4ce0-a407-5eae1e218560 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
12892024-12-21T08:30:54.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = fd3e34e0-9ed0-4ce0-a407-5eae1e218560 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
12902024-12-21T08:30:54.530ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1507 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = 7277b507-2f11-43ce-b4d4-a49447959382 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
12912024-12-21T08:30:55.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = df945566-4d4a-4766-943d-0a8427f94548 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
12922024-12-21T08:30:55.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = df945566-4d4a-4766-943d-0a8427f94548 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
12932024-12-21T08:30:55.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = df945566-4d4a-4766-943d-0a8427f94548 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
12942024-12-21T08:30:55.395ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
12952024-12-21T08:30:55.396ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
12962024-12-21T08:30:55.427ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
12972024-12-21T08:30:55.427ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:61577
12982024-12-21T08:30:55.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61577 req_id = 97c7a51e-7eb4-4a1d-a975-785dd7d88f5f roles = RoleSet { roles: {} } uri = /metrics/producers
12992024-12-21T08:30:55.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61577 req_id = 97c7a51e-7eb4-4a1d-a975-785dd7d88f5f resource = Database result = Ok(()) uri = /metrics/producers
13002024-12-21T08:30:55.466ZINFOnexus: assigned collector to new producer collector_id = d3e17b73-750a-4d54-b6e9-cb13b0984ebb file = nexus/src/app/oximeter.rs:76 producer_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
13012024-12-21T08:30:55.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38776 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61577 req_id = 97c7a51e-7eb4-4a1d-a975-785dd7d88f5f response_code = 201 uri = /metrics/producers
13022024-12-21T08:30:55.466ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "97c7a51e-7eb4-4a1d-a975-785dd7d88f5f", "content-length": "41", "date": "Sat, 21 Dec 2024 08:30:54 GMT"} })
13032024-12-21T08:30:55.468ZDEBGnexus (producer-registration-task): registered with nexus successfully
13042024-12-21T08:30:55.468ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
13052024-12-21T08:30:56.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e18f2dac-ae18-4e4c-be64-a2fe685bd5f9 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13062024-12-21T08:30:56.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e18f2dac-ae18-4e4c-be64-a2fe685bd5f9 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13072024-12-21T08:30:56.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e18f2dac-ae18-4e4c-be64-a2fe685bd5f9 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13082024-12-21T08:30:57.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = cb57204e-910b-4983-af75-9a8c19ee1aca roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13092024-12-21T08:30:57.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = cb57204e-910b-4983-af75-9a8c19ee1aca resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13102024-12-21T08:30:57.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = cb57204e-910b-4983-af75-9a8c19ee1aca response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13112024-12-21T08:30:58.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4aa66ddf-d3fb-4c9b-aafe-b336b6b1e9f4 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13122024-12-21T08:30:58.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4aa66ddf-d3fb-4c9b-aafe-b336b6b1e9f4 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13132024-12-21T08:30:58.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4aa66ddf-d3fb-4c9b-aafe-b336b6b1e9f4 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13142024-12-21T08:30:59.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4a2b48cc-ff76-4bed-bc69-6fd8c9d6e9d0 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13152024-12-21T08:30:59.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4a2b48cc-ff76-4bed-bc69-6fd8c9d6e9d0 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13162024-12-21T08:30:59.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4a2b48cc-ff76-4bed-bc69-6fd8c9d6e9d0 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13172024-12-21T08:31:00.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 715e4942-8e4e-48d6-97c6-fb72795e4fdb roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13182024-12-21T08:31:00.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 715e4942-8e4e-48d6-97c6-fb72795e4fdb resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13192024-12-21T08:31:00.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 715e4942-8e4e-48d6-97c6-fb72795e4fdb response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13202024-12-21T08:31:01.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d571a1e2-c12c-44c1-9035-be9382dc2c3e roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13212024-12-21T08:31:01.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d571a1e2-c12c-44c1-9035-be9382dc2c3e resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13222024-12-21T08:31:01.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d571a1e2-c12c-44c1-9035-be9382dc2c3e response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13232024-12-21T08:31:01.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
13242024-12-21T08:31:01.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13252024-12-21T08:31:01.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
13262024-12-21T08:31:01.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13272024-12-21T08:31:01.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13282024-12-21T08:31:01.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13292024-12-21T08:31:01.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13302024-12-21T08:31:01.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13312024-12-21T08:31:01.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13322024-12-21T08:31:01.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.854984ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13332024-12-21T08:31:01.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13342024-12-21T08:31:01.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13352024-12-21T08:31:01.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13362024-12-21T08:31:01.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13372024-12-21T08:31:01.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13382024-12-21T08:31:01.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13392024-12-21T08:31:01.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
13402024-12-21T08:31:01.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13412024-12-21T08:31:01.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13422024-12-21T08:31:01.551ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
13432024-12-21T08:31:01.551ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.42368ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
13442024-12-21T08:31:02.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e073a811-6c3b-48cd-95b1-46a5e61775c0 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13452024-12-21T08:31:02.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e073a811-6c3b-48cd-95b1-46a5e61775c0 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13462024-12-21T08:31:02.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e073a811-6c3b-48cd-95b1-46a5e61775c0 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13472024-12-21T08:31:03.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f3d5038d-e855-4dfe-9c85-79c1dd706b5b roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13482024-12-21T08:31:03.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f3d5038d-e855-4dfe-9c85-79c1dd706b5b resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13492024-12-21T08:31:03.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f3d5038d-e855-4dfe-9c85-79c1dd706b5b response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13502024-12-21T08:31:04.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 018bfc39-5906-4a04-993c-714a327dfef2 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13512024-12-21T08:31:04.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 018bfc39-5906-4a04-993c-714a327dfef2 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13522024-12-21T08:31:04.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2726 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 018bfc39-5906-4a04-993c-714a327dfef2 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13532024-12-21T08:31:04.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 62bd2780-0886-46a1-98e3-45138a8bc793 roles = RoleSet { roles: {} } uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?sort_by=id_ascending
13542024-12-21T08:31:04.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 62bd2780-0886-46a1-98e3-45138a8bc793 resource = Database result = Ok(()) uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?sort_by=id_ascending
13552024-12-21T08:31:04.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3678 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 62bd2780-0886-46a1-98e3-45138a8bc793 response_code = 200 uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?sort_by=id_ascending
13562024-12-21T08:31:04.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 5bc278e1-c89e-46ba-bc0b-e70863b09c1e roles = RoleSet { roles: {} } uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWY2MjFkYy01ODFkLTQ1Y2MtOGViYy05NGE0ZDIyN2NkZmIifX0%3D
13572024-12-21T08:31:04.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 5bc278e1-c89e-46ba-bc0b-e70863b09c1e resource = Database result = Ok(()) uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWY2MjFkYy01ODFkLTQ1Y2MtOGViYy05NGE0ZDIyN2NkZmIifX0%3D
13582024-12-21T08:31:04.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 5bc278e1-c89e-46ba-bc0b-e70863b09c1e response_code = 200 uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWY2MjFkYy01ODFkLTQ1Y2MtOGViYy05NGE0ZDIyN2NkZmIifX0%3D
13592024-12-21T08:31:04.531ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1808 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = ddf121ea-9b7d-45dc-aa63-e638fbd24d20 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
13602024-12-21T08:31:05.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c7b8651f-921f-4c23-a009-d84e36fa738c roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13612024-12-21T08:31:05.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c7b8651f-921f-4c23-a009-d84e36fa738c resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13622024-12-21T08:31:05.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c7b8651f-921f-4c23-a009-d84e36fa738c response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13632024-12-21T08:31:05.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = ac11bcda-4cd7-4b4b-bc2d-a4ce58d58b8e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
13642024-12-21T08:31:05.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = ac11bcda-4cd7-4b4b-bc2d-a4ce58d58b8e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
13652024-12-21T08:31:05.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = ac11bcda-4cd7-4b4b-bc2d-a4ce58d58b8e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
13662024-12-21T08:31:06.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ba250300-d8a6-4455-bc9c-9c81aaf332c4 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13672024-12-21T08:31:06.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ba250300-d8a6-4455-bc9c-9c81aaf332c4 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13682024-12-21T08:31:06.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ba250300-d8a6-4455-bc9c-9c81aaf332c4 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13692024-12-21T08:31:07.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ecc91678-4c97-47d0-9e05-34ba3dd70513 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13702024-12-21T08:31:07.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ecc91678-4c97-47d0-9e05-34ba3dd70513 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13712024-12-21T08:31:07.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ecc91678-4c97-47d0-9e05-34ba3dd70513 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13722024-12-21T08:31:08.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 82b9b842-5223-40b8-a5cd-170d1d2835e2 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13732024-12-21T08:31:08.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 82b9b842-5223-40b8-a5cd-170d1d2835e2 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13742024-12-21T08:31:08.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 82b9b842-5223-40b8-a5cd-170d1d2835e2 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13752024-12-21T08:31:09.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = eb9dd21d-bf25-49db-9968-b6d597a3abae roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13762024-12-21T08:31:09.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = eb9dd21d-bf25-49db-9968-b6d597a3abae resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13772024-12-21T08:31:09.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = eb9dd21d-bf25-49db-9968-b6d597a3abae response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13782024-12-21T08:31:10.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 19db4b61-6352-425f-b80d-42837307e439 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13792024-12-21T08:31:10.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 19db4b61-6352-425f-b80d-42837307e439 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13802024-12-21T08:31:10.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 19db4b61-6352-425f-b80d-42837307e439 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13812024-12-21T08:31:11.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 23f930fd-6fca-4be4-86e2-a405acc20eb1 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13822024-12-21T08:31:11.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 23f930fd-6fca-4be4-86e2-a405acc20eb1 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13832024-12-21T08:31:11.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 23f930fd-6fca-4be4-86e2-a405acc20eb1 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
13842024-12-21T08:31:11.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
13852024-12-21T08:31:11.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
13862024-12-21T08:31:11.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13872024-12-21T08:31:11.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13882024-12-21T08:31:11.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13892024-12-21T08:31:11.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13902024-12-21T08:31:11.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13912024-12-21T08:31:11.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13922024-12-21T08:31:11.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13932024-12-21T08:31:11.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13942024-12-21T08:31:11.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13952024-12-21T08:31:11.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.677351ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13962024-12-21T08:31:11.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13972024-12-21T08:31:11.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13982024-12-21T08:31:11.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13992024-12-21T08:31:11.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14002024-12-21T08:31:11.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
14012024-12-21T08:31:11.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14022024-12-21T08:31:11.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14032024-12-21T08:31:11.551ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
14042024-12-21T08:31:11.551ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.835275ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
14052024-12-21T08:31:12.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 76d1a171-d48f-4b26-bd28-33e94dc0300c roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14062024-12-21T08:31:12.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 76d1a171-d48f-4b26-bd28-33e94dc0300c resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14072024-12-21T08:31:12.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1702 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 76d1a171-d48f-4b26-bd28-33e94dc0300c response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14082024-12-21T08:31:13.226ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45825
14092024-12-21T08:31:13.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45825 req_id = cd5c6284-72a0-4a27-a78a-cc00fed4bf7a roles = RoleSet { roles: {} } uri = /metrics/producers
14102024-12-21T08:31:13.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45825 req_id = cd5c6284-72a0-4a27-a78a-cc00fed4bf7a resource = Database result = Ok(()) uri = /metrics/producers
14112024-12-21T08:31:13.274ZINFOnexus: assigned collector to new producer collector_id = d3e17b73-750a-4d54-b6e9-cb13b0984ebb file = nexus/src/app/oximeter.rs:76 producer_id = f9f621dc-581d-45cc-8ebc-94a4d227cdfb
14122024-12-21T08:31:13.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47917 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45825 req_id = cd5c6284-72a0-4a27-a78a-cc00fed4bf7a response_code = 201 uri = /metrics/producers
14132024-12-21T08:31:13.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c35304fd-237d-4f7a-b8d9-0bcd597d3241 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14142024-12-21T08:31:13.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c35304fd-237d-4f7a-b8d9-0bcd597d3241 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14152024-12-21T08:31:13.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c35304fd-237d-4f7a-b8d9-0bcd597d3241 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14162024-12-21T08:31:14.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f0f68670-909e-490a-bcaa-03a173d31b58 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14172024-12-21T08:31:14.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f0f68670-909e-490a-bcaa-03a173d31b58 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14182024-12-21T08:31:14.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2662 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f0f68670-909e-490a-bcaa-03a173d31b58 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14192024-12-21T08:31:14.530ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1322 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = 74afb071-a57f-4002-8488-d193691c27b6 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
14202024-12-21T08:31:15.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4c23b19f-08cd-4ac9-b404-3685ededa332 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14212024-12-21T08:31:15.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4c23b19f-08cd-4ac9-b404-3685ededa332 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14222024-12-21T08:31:15.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4c23b19f-08cd-4ac9-b404-3685ededa332 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14232024-12-21T08:31:16.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9f7216e7-ef69-4f9a-bf1e-ee88b1762c3e roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14242024-12-21T08:31:16.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9f7216e7-ef69-4f9a-bf1e-ee88b1762c3e resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14252024-12-21T08:31:16.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9f7216e7-ef69-4f9a-bf1e-ee88b1762c3e response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14262024-12-21T08:31:17.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0b0a18de-0261-46e3-b88c-865baf751fee roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14272024-12-21T08:31:17.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0b0a18de-0261-46e3-b88c-865baf751fee resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14282024-12-21T08:31:17.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0b0a18de-0261-46e3-b88c-865baf751fee response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14292024-12-21T08:31:18.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 59d8d0a3-3a39-4d47-87f8-7886929efc6a roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14302024-12-21T08:31:18.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 59d8d0a3-3a39-4d47-87f8-7886929efc6a resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14312024-12-21T08:31:18.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 59d8d0a3-3a39-4d47-87f8-7886929efc6a response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14322024-12-21T08:31:19.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = cbd42e97-b89e-48e5-9c41-3169628b3fbb roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14332024-12-21T08:31:19.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = cbd42e97-b89e-48e5-9c41-3169628b3fbb resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14342024-12-21T08:31:19.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = cbd42e97-b89e-48e5-9c41-3169628b3fbb response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14352024-12-21T08:31:20.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a16e1eb2-39b1-4b42-855e-7198e3a6f8bd roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14362024-12-21T08:31:20.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a16e1eb2-39b1-4b42-855e-7198e3a6f8bd resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14372024-12-21T08:31:20.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a16e1eb2-39b1-4b42-855e-7198e3a6f8bd response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
14382024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
14392024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
14402024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
14412024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14422024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14432024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
14442024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14452024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
14462024-12-21T08:31:21.530ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302
14472024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 27.25\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302"}
14482024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
14492024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
14502024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
14512024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14522024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14532024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
14542024-12-21T08:31:21.530ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14552024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
14562024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
14572024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14582024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14592024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
14602024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14612024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
14622024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
14632024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14642024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
14652024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14662024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
14672024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14682024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
14692024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14702024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
14712024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
14722024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14732024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
14742024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14752024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
14762024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14772024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
14782024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14792024-12-21T08:31:21.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14802024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
14812024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
14822024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14832024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
14842024-12-21T08:31:21.531ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
14852024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14862024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
14872024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14882024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
14892024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
14902024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
14912024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14922024-12-21T08:31:21.531ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 08:21:21.530953571 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
14932024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
14942024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
14952024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14962024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
14972024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
14982024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
14992024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
15002024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15012024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15022024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15032024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15042024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15052024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
15062024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15072024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15082024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15092024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15102024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
15112024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15122024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15132024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15142024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15152024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15162024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
15172024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15182024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15192024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
15202024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15212024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15222024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15232024-12-21T08:31:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15242024-12-21T08:31:21.531ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5037fa1b-4769-431c-8e17-0ed172e6d4e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea826706-9f75-4635-8793-1730a859a368.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea826706-9f75-4635-8793-1730a859a368.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1763, tv_nsec: 520307693 } })
15252024-12-21T08:31:21.531ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("35bcbd45-3578-45df-b73d-00c21093df02.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50a4d151-f70f-4790-a525-028d2812625b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bdf4fa9e-0938-4aac-903e-8935b21f0685.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bdf4fa9e-0938-4aac-903e-8935b21f0685.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1763, tv_nsec: 520351883 } })
15262024-12-21T08:31:21.532ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
15272024-12-21T08:31:21.532ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.216811ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
15282024-12-21T08:31:21.532ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
15292024-12-21T08:31:21.532ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.14209ms iteration = 15 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
15302024-12-21T08:31:21.532ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15312024-12-21T08:31:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15322024-12-21T08:31:21.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15332024-12-21T08:31:21.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15342024-12-21T08:31:21.534ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15352024-12-21T08:31:21.534ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.150736ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15362024-12-21T08:31:21.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15372024-12-21T08:31:21.535ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15382024-12-21T08:31:21.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15392024-12-21T08:31:21.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15402024-12-21T08:31:21.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15412024-12-21T08:31:21.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15422024-12-21T08:31:21.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
15432024-12-21T08:31:21.537ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
15442024-12-21T08:31:21.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15452024-12-21T08:31:21.538ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
15462024-12-21T08:31:21.538ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
15472024-12-21T08:31:21.538ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 8.098242ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
15482024-12-21T08:31:21.539ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15492024-12-21T08:31:21.539ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.03806ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
15502024-12-21T08:31:21.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15512024-12-21T08:31:21.540ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15522024-12-21T08:31:21.540ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15532024-12-21T08:31:21.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15542024-12-21T08:31:21.541ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1763, tv_nsec: 530557653 } })
15552024-12-21T08:31:21.542ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
15562024-12-21T08:31:21.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15572024-12-21T08:31:21.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15582024-12-21T08:31:21.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15592024-12-21T08:31:21.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15602024-12-21T08:31:21.544ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15612024-12-21T08:31:21.544ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15622024-12-21T08:31:21.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15632024-12-21T08:31:21.544ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 08:21:21.530953571 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
15642024-12-21T08:31:21.544ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.992053ms iteration = 14 status = {"expiration":"2024-12-21T08:21:21.530953571Z","pruned":[]}
15652024-12-21T08:31:21.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15662024-12-21T08:31:21.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.722659ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
15672024-12-21T08:31:21.545ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1763, tv_nsec: 534725350 } })
15682024-12-21T08:31:21.546ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
15692024-12-21T08:31:21.546ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15702024-12-21T08:31:21.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15712024-12-21T08:31:21.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15722024-12-21T08:31:21.547ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15732024-12-21T08:31:21.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15742024-12-21T08:31:21.548ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15752024-12-21T08:31:21.548ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15762024-12-21T08:31:21.548ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15772024-12-21T08:31:21.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15782024-12-21T08:31:21.548ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15792024-12-21T08:31:21.550ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1763, tv_nsec: 538908727 } })
15802024-12-21T08:31:21.550ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15812024-12-21T08:31:21.550ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
15822024-12-21T08:31:21.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15832024-12-21T08:31:21.551ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15842024-12-21T08:31:21.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15852024-12-21T08:31:21.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15862024-12-21T08:31:21.553ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15872024-12-21T08:31:21.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15882024-12-21T08:31:21.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15892024-12-21T08:31:21.555ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15902024-12-21T08:31:21.556ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15912024-12-21T08:31:21.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15922024-12-21T08:31:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15932024-12-21T08:31:21.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15942024-12-21T08:31:21.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15952024-12-21T08:31:21.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15962024-12-21T08:31:21.559ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15972024-12-21T08:31:21.559ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 28.464731ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15982024-12-21T08:31:21.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15992024-12-21T08:31:21.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16002024-12-21T08:31:21.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16012024-12-21T08:31:21.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16022024-12-21T08:31:21.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16032024-12-21T08:31:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16042024-12-21T08:31:21.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 47.139386ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
16052024-12-21T08:31:21.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 47.775882ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16062024-12-21T08:31:21.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16072024-12-21T08:31:21.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16082024-12-21T08:31:21.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16092024-12-21T08:31:21.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16102024-12-21T08:31:21.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16112024-12-21T08:31:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16122024-12-21T08:31:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16132024-12-21T08:31:21.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16142024-12-21T08:31:21.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16152024-12-21T08:31:21.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16162024-12-21T08:31:21.587ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16172024-12-21T08:31:21.587ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16182024-12-21T08:31:21.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16192024-12-21T08:31:21.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.308884ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16202024-12-21T08:31:21.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16212024-12-21T08:31:21.589ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
16222024-12-21T08:31:21.589ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
16232024-12-21T08:31:21.589ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
16242024-12-21T08:31:21.589ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16252024-12-21T08:31:21.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16262024-12-21T08:31:21.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16272024-12-21T08:31:21.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3b53ba2d-4d00-44a6-bd37-8306adc194ea, lookup_type: ById(3b53ba2d-4d00-44a6-bd37-8306adc194ea) } result = Ok(())
16282024-12-21T08:31:21.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16292024-12-21T08:31:21.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16302024-12-21T08:31:21.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16312024-12-21T08:31:21.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.903166ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16322024-12-21T08:31:21.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16332024-12-21T08:31:21.593ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.515002ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
16342024-12-21T08:31:21.593ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 62.953515ms iteration = 27 status = 0
16352024-12-21T08:31:21.595ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16362024-12-21T08:31:21.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16372024-12-21T08:31:21.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16382024-12-21T08:31:21.596ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
16392024-12-21T08:31:21.596ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
16402024-12-21T08:31:21.596ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 66.268754ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
16412024-12-21T08:31:21.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16422024-12-21T08:31:21.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
16432024-12-21T08:31:21.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16442024-12-21T08:31:21.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16452024-12-21T08:31:21.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
16462024-12-21T08:31:21.599ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16472024-12-21T08:31:21.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16482024-12-21T08:31:21.599ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16492024-12-21T08:31:21.601ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16502024-12-21T08:31:21.601ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
16512024-12-21T08:31:21.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16522024-12-21T08:31:21.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16532024-12-21T08:31:21.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16542024-12-21T08:31:21.621ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
16552024-12-21T08:31:21.621ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.63661ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
16562024-12-21T08:31:21.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f7b1e66c-4a13-42c8-8c55-919bea834f27 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
16572024-12-21T08:31:21.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f7b1e66c-4a13-42c8-8c55-919bea834f27 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
16582024-12-21T08:31:21.637ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16592024-12-21T08:31:21.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
16602024-12-21T08:31:21.638ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16612024-12-21T08:31:21.638ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e0ed7f2-a28d-41ab-87a3-81b7138901c7 dns_zone_name = oxide.test found_so_far = 0 version = 2
16622024-12-21T08:31:21.638ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16632024-12-21T08:31:21.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f7b1e66c-4a13-42c8-8c55-919bea834f27 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
16642024-12-21T08:31:21.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16652024-12-21T08:31:21.642ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16662024-12-21T08:31:21.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16672024-12-21T08:31:21.645ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
16682024-12-21T08:31:21.645ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
16692024-12-21T08:31:21.645ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
16702024-12-21T08:31:21.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16712024-12-21T08:31:21.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16722024-12-21T08:31:21.649ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16732024-12-21T08:31:21.650ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16742024-12-21T08:31:21.650ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.151601ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16752024-12-21T08:31:21.668ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16762024-12-21T08:31:21.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16772024-12-21T08:31:21.671ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 141.278766ms iteration = 31 status = {"physical_disks_added":0}
16782024-12-21T08:31:21.713ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16792024-12-21T08:31:21.713ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16802024-12-21T08:31:21.713ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd1b625a-0246-4236-ac21-fbb6342ee01d", "content-length": "26", "date": "Sat, 21 Dec 2024 08:31:21 GMT"} })
16812024-12-21T08:31:21.713ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16822024-12-21T08:31:21.716ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16832024-12-21T08:31:21.752ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
16842024-12-21T08:31:21.769ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
16852024-12-21T08:31:21.806ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16862024-12-21T08:31:21.806ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16872024-12-21T08:31:21.807ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c731f71-193a-410e-a693-a04f9e8b10f7", "content-length": "372", "date": "Sat, 21 Dec 2024 08:31:21 GMT"} })
16882024-12-21T08:31:21.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16892024-12-21T08:31:21.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16902024-12-21T08:31:21.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16912024-12-21T08:31:21.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16922024-12-21T08:31:21.809ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16932024-12-21T08:31:21.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16942024-12-21T08:31:21.811ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16952024-12-21T08:31:21.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16962024-12-21T08:31:21.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16972024-12-21T08:31:21.812ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16982024-12-21T08:31:21.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16992024-12-21T08:31:21.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17002024-12-21T08:31:21.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17012024-12-21T08:31:21.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17022024-12-21T08:31:21.815ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e0ed7f2-a28d-41ab-87a3-81b7138901c7 dns_zone_name = oxide.test found_so_far = 1 version = 2
17032024-12-21T08:31:21.815ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
17042024-12-21T08:31:21.815ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 08:18:23.563952 UTC dns_group = external generation = 2
17052024-12-21T08:31:21.815ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 284.782083ms iteration = 15 status = {"generation":2}
17062024-12-21T08:31:21.815ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
17072024-12-21T08:31:21.815ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 825f8681-b5f6-43ad-8053-b0be9965d93d dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
17082024-12-21T08:31:21.815ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17092024-12-21T08:31:21.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17102024-12-21T08:31:21.817ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17112024-12-21T08:31:21.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17122024-12-21T08:31:21.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17132024-12-21T08:31:21.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17142024-12-21T08:31:21.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17152024-12-21T08:31:21.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17162024-12-21T08:31:21.820ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17172024-12-21T08:31:21.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17182024-12-21T08:31:21.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17192024-12-21T08:31:21.822ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 825f8681-b5f6-43ad-8053-b0be9965d93d dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
17202024-12-21T08:31:21.822ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
17212024-12-21T08:31:21.822ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 08:18:22.068410 UTC dns_group = internal generation = 1
17222024-12-21T08:31:21.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17232024-12-21T08:31:21.822ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 291.746643ms iteration = 15 status = {"generation":1}
17242024-12-21T08:31:21.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17252024-12-21T08:31:21.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17262024-12-21T08:31:21.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17272024-12-21T08:31:21.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17282024-12-21T08:31:21.827ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
17292024-12-21T08:31:21.827ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17302024-12-21T08:31:21.827ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c2f6835b-5c81-4c16-9744-abe30bd52ebf", "date": "Sat, 21 Dec 2024 08:31:21 GMT"} })
17312024-12-21T08:31:21.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17322024-12-21T08:31:21.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17332024-12-21T08:31:21.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17342024-12-21T08:31:21.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17352024-12-21T08:31:21.835ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17362024-12-21T08:31:21.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17372024-12-21T08:31:21.838ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17382024-12-21T08:31:21.838ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17392024-12-21T08:31:21.839ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1bd2dd58-c8ac-4710-88c3-76d4209a84c0", "date": "Sat, 21 Dec 2024 08:31:21 GMT"} })
17402024-12-21T08:31:21.840ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 309.790643ms iteration = 29 status = {}
17412024-12-21T08:31:21.858ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T08:18:19.279666Z, time_modified: 2024-12-21T08:18:19.279666Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 36ce767e-8d13-48fc-b54f-25a543752b28, db_silo: Silo { identity: SiloIdentity { id: 36ce767e-8d13-48fc-b54f-25a543752b28, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T08:18:23.511483Z, time_modified: 2024-12-21T08:18:23.511483Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d4d3d1815f342882ad1c1687b3d9b611837e26888f379a800d2fbe2710458245" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 36ce767e-8d13-48fc-b54f-25a543752b28, db_silo: Silo { identity: SiloIdentity { id: 36ce767e-8d13-48fc-b54f-25a543752b28, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T08:18:23.511483Z, time_modified: 2024-12-21T08:18:23.511483Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d4d3d1815f342882ad1c1687b3d9b611837e26888f379a800d2fbe2710458245" }] }) }
17422024-12-21T08:31:21.858ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 327.748751ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"36ce767e-8d13-48fc-b54f-25a543752b28","tls_certs":["d4d3d1815f342882ad1c1687b3d9b611837e26888f379a800d2fbe2710458245"]}},"default_endpoint":{"silo_id":"36ce767e-8d13-48fc-b54f-25a543752b28","tls_certs":["d4d3d1815f342882ad1c1687b3d9b611837e26888f379a800d2fbe2710458245"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
17432024-12-21T08:31:21.862ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
17442024-12-21T08:31:21.862ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 331.960628ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
17452024-12-21T08:31:21.865ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
17462024-12-21T08:31:21.865ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17472024-12-21T08:31:21.865ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1528970d-d336-465d-8953-5c10b80e7669", "content-length": "26", "date": "Sat, 21 Dec 2024 08:31:21 GMT"} })
17482024-12-21T08:31:21.865ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17492024-12-21T08:31:21.867ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 zone_address = fd00:1122:3344:101::2
17502024-12-21T08:31:21.867ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17512024-12-21T08:31:21.868ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17522024-12-21T08:31:21.868ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d18f33a-599a-4989-ac2f-187caafa51d5", "content-length": "26", "date": "Sat, 21 Dec 2024 08:31:21 GMT"} })
17532024-12-21T08:31:21.868ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17542024-12-21T08:31:21.870ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
17552024-12-21T08:31:21.929ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 398.792077ms iteration = 27 status = {}
17562024-12-21T08:31:21.985ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
17572024-12-21T08:31:21.985ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17582024-12-21T08:31:21.985ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ab75cca1-a5f8-4ac0-a5cf-b5519e015f26", "date": "Sat, 21 Dec 2024 08:31:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17592024-12-21T08:31:21.985ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17602024-12-21T08:31:21.985ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c41ac3a-41a5-4e60-9a5b-fd9570ec5572", "content-length": "691", "date": "Sat, 21 Dec 2024 08:31:21 GMT"} })
17612024-12-21T08:31:21.986ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
17622024-12-21T08:31:21.986ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
17632024-12-21T08:31:21.986ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
17642024-12-21T08:31:21.987ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
17652024-12-21T08:31:21.989ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ff51dbb1-002e-4965-b02f-1a94a7c239b6", "date": "Sat, 21 Dec 2024 08:31:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17662024-12-21T08:31:21.989ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17672024-12-21T08:31:21.990ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 459.522343ms iteration = 28 status = {}
17682024-12-21T08:31:21.992ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17692024-12-21T08:31:21.992ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 461.39745ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
17702024-12-21T08:31:22.013ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17712024-12-21T08:31:22.013ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0019a023-00e1-4f49-9bd2-b1f0bd88b03d", "content-length": "2", "date": "Sat, 21 Dec 2024 08:31:21 GMT"} })
17722024-12-21T08:31:22.016ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17732024-12-21T08:31:22.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17742024-12-21T08:31:22.018ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 487.43487ms iteration = 27 status = null
17752024-12-21T08:31:22.059ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
17762024-12-21T08:31:22.060ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8a13934b-d9d0-4983-bbb2-efed33e492bf", "date": "Sat, 21 Dec 2024 08:31:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
17772024-12-21T08:31:22.060ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
17782024-12-21T08:31:22.064ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7b9215fb-6eb7-4710-b128-ed94ac7656af", "date": "Sat, 21 Dec 2024 08:31:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
17792024-12-21T08:31:22.064ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
17802024-12-21T08:31:22.067ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "94d7cf78-bc69-4d2e-8ad1-f6cf8752ef6c", "date": "Sat, 21 Dec 2024 08:31:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
17812024-12-21T08:31:22.067ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
17822024-12-21T08:31:22.069ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
17832024-12-21T08:31:22.069ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 538.863224ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
17842024-12-21T08:31:22.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17852024-12-21T08:31:22.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17862024-12-21T08:31:22.114ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4986737f-c249-4380-901f-c7ce67751b89, rack_id: dcff325a-cbfd-4a8c-805a-d5b8a1a42707, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a98489e0-d62f-4837-a1f0-df124db3049c) } rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0
17872024-12-21T08:31:22.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17882024-12-21T08:31:22.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17892024-12-21T08:31:22.137ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17902024-12-21T08:31:22.137ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4dfa7a99-3c55-4b13-9a6e-04504e721d96", "content-length": "134", "date": "Sat, 21 Dec 2024 08:31:21 GMT"} })
17912024-12-21T08:31:22.137ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17922024-12-21T08:31:22.137ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a98489e0-d62f-4837-a1f0-df124db3049c
17932024-12-21T08:31:22.138ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17942024-12-21T08:31:22.138ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17952024-12-21T08:31:22.138ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17962024-12-21T08:31:22.138ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17972024-12-21T08:31:22.138ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17982024-12-21T08:31:22.138ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17992024-12-21T08:31:22.138ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18002024-12-21T08:31:22.138ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18012024-12-21T08:31:22.138ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
18022024-12-21T08:31:22.138ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18032024-12-21T08:31:22.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18042024-12-21T08:31:22.142ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18052024-12-21T08:31:22.142ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5aea4719-9c9c-4752-9a90-a737d58893b3", "content-length": "2", "date": "Sat, 21 Dec 2024 08:31:21 GMT"} })
18062024-12-21T08:31:22.142ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18072024-12-21T08:31:22.142ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "81d8c8fc-f977-4b37-8789-6854fca7dc83", "content-length": "52", "date": "Sat, 21 Dec 2024 08:31:21 GMT"} })
18082024-12-21T08:31:22.142ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0
18092024-12-21T08:31:22.142ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18102024-12-21T08:31:22.259ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e7b62130-e20c-4bad-8220-4f080304b13b", "date": "Sat, 21 Dec 2024 08:31:22 GMT"} })
18112024-12-21T08:31:22.259ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch = Switch0
18122024-12-21T08:31:22.259ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18132024-12-21T08:31:22.259ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "892dd04f-7b11-428c-8590-dcdcf7883b1e", "content-length": "682", "date": "Sat, 21 Dec 2024 08:31:22 GMT"} })
18142024-12-21T08:31:22.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18152024-12-21T08:31:22.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18162024-12-21T08:31:22.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18172024-12-21T08:31:22.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18182024-12-21T08:31:22.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18192024-12-21T08:31:22.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18202024-12-21T08:31:22.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18212024-12-21T08:31:22.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18222024-12-21T08:31:22.288ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 757.516751ms iteration = 27 status = {}
18232024-12-21T08:31:22.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 72c39b8f-ec59-4216-9222-d034656581ad roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18242024-12-21T08:31:22.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 72c39b8f-ec59-4216-9222-d034656581ad resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18252024-12-21T08:31:22.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1721 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 72c39b8f-ec59-4216-9222-d034656581ad response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18262024-12-21T08:31:23.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 076e5bd3-dbfb-4013-a072-9147fb9fc89c roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18272024-12-21T08:31:23.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 076e5bd3-dbfb-4013-a072-9147fb9fc89c resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18282024-12-21T08:31:23.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 076e5bd3-dbfb-4013-a072-9147fb9fc89c response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18292024-12-21T08:31:24.531ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1648 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = f065624c-d0cb-408c-a4b3-940b40ac1306 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
18302024-12-21T08:31:24.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 691d0a74-3b71-49c1-bf68-642691092c1b roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18312024-12-21T08:31:24.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 691d0a74-3b71-49c1-bf68-642691092c1b resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18322024-12-21T08:31:24.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 691d0a74-3b71-49c1-bf68-642691092c1b response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18332024-12-21T08:31:25.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6d7a6f3a-fdf5-4f0b-9495-49d0b1df8d9d roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18342024-12-21T08:31:25.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6d7a6f3a-fdf5-4f0b-9495-49d0b1df8d9d resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18352024-12-21T08:31:25.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6d7a6f3a-fdf5-4f0b-9495-49d0b1df8d9d response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18362024-12-21T08:31:26.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dd5db805-adbf-45bd-a606-ca69251d185b roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18372024-12-21T08:31:26.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dd5db805-adbf-45bd-a606-ca69251d185b resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18382024-12-21T08:31:26.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dd5db805-adbf-45bd-a606-ca69251d185b response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18392024-12-21T08:31:27.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dc98fd10-1f4b-47f6-9b37-1a44d0653acf roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18402024-12-21T08:31:27.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dc98fd10-1f4b-47f6-9b37-1a44d0653acf resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18412024-12-21T08:31:27.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dc98fd10-1f4b-47f6-9b37-1a44d0653acf response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18422024-12-21T08:31:28.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 05ebfb1c-e6ff-4294-b8bf-5f8ffc84df62 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18432024-12-21T08:31:28.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 05ebfb1c-e6ff-4294-b8bf-5f8ffc84df62 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18442024-12-21T08:31:28.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 05ebfb1c-e6ff-4294-b8bf-5f8ffc84df62 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18452024-12-21T08:31:29.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6e83c74a-fbd5-45ce-84b9-014bba5b683b roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18462024-12-21T08:31:29.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6e83c74a-fbd5-45ce-84b9-014bba5b683b resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18472024-12-21T08:31:29.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6e83c74a-fbd5-45ce-84b9-014bba5b683b response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18482024-12-21T08:31:30.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 05758f5d-ac98-4ff7-9273-33359b8b6c11 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18492024-12-21T08:31:30.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 05758f5d-ac98-4ff7-9273-33359b8b6c11 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18502024-12-21T08:31:30.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 05758f5d-ac98-4ff7-9273-33359b8b6c11 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18512024-12-21T08:31:31.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
18522024-12-21T08:31:31.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
18532024-12-21T08:31:31.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18542024-12-21T08:31:31.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18552024-12-21T08:31:31.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18562024-12-21T08:31:31.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18572024-12-21T08:31:31.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18582024-12-21T08:31:31.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18592024-12-21T08:31:31.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18602024-12-21T08:31:31.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.074196ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18612024-12-21T08:31:31.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18622024-12-21T08:31:31.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18632024-12-21T08:31:31.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18642024-12-21T08:31:31.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18652024-12-21T08:31:31.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18662024-12-21T08:31:31.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18672024-12-21T08:31:31.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
18682024-12-21T08:31:31.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18692024-12-21T08:31:31.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18702024-12-21T08:31:31.550ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
18712024-12-21T08:31:31.550ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.945606ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
18722024-12-21T08:31:31.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b8513e31-2792-4fe4-aa71-8d3fe35e4764 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18732024-12-21T08:31:31.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b8513e31-2792-4fe4-aa71-8d3fe35e4764 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18742024-12-21T08:31:31.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b8513e31-2792-4fe4-aa71-8d3fe35e4764 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18752024-12-21T08:31:32.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7af2df3e-3c96-4794-be81-23cd561bcf22 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18762024-12-21T08:31:32.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7af2df3e-3c96-4794-be81-23cd561bcf22 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18772024-12-21T08:31:32.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7af2df3e-3c96-4794-be81-23cd561bcf22 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18782024-12-21T08:31:33.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d02d3b00-b3ef-4bf0-96ed-763ff6c3129d roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18792024-12-21T08:31:33.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d02d3b00-b3ef-4bf0-96ed-763ff6c3129d resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18802024-12-21T08:31:33.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d02d3b00-b3ef-4bf0-96ed-763ff6c3129d response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18812024-12-21T08:31:34.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 245a56de-2392-40b3-b1d9-aebd1c9896eb roles = RoleSet { roles: {} } uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?sort_by=id_ascending
18822024-12-21T08:31:34.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 245a56de-2392-40b3-b1d9-aebd1c9896eb resource = Database result = Ok(()) uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?sort_by=id_ascending
18832024-12-21T08:31:34.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3722 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 245a56de-2392-40b3-b1d9-aebd1c9896eb response_code = 200 uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?sort_by=id_ascending
18842024-12-21T08:31:34.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 81bba509-866b-4ddb-856b-e156a7a8c61f roles = RoleSet { roles: {} } uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWY2MjFkYy01ODFkLTQ1Y2MtOGViYy05NGE0ZDIyN2NkZmIifX0%3D
18852024-12-21T08:31:34.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 81bba509-866b-4ddb-856b-e156a7a8c61f resource = Database result = Ok(()) uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWY2MjFkYy01ODFkLTQ1Y2MtOGViYy05NGE0ZDIyN2NkZmIifX0%3D
18862024-12-21T08:31:34.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 81bba509-866b-4ddb-856b-e156a7a8c61f response_code = 200 uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWY2MjFkYy01ODFkLTQ1Y2MtOGViYy05NGE0ZDIyN2NkZmIifX0%3D
18872024-12-21T08:31:34.532ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1597 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = 99d1a5da-7212-4455-ba5a-a9ff1f85bad1 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
18882024-12-21T08:31:34.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 32a8f3ba-4966-408c-b91e-68f8c9d74bf5 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18892024-12-21T08:31:34.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 32a8f3ba-4966-408c-b91e-68f8c9d74bf5 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18902024-12-21T08:31:34.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 32a8f3ba-4966-408c-b91e-68f8c9d74bf5 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18912024-12-21T08:31:35.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = 9a03ceff-223f-46f2-a4b2-8c7e0e285bbd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
18922024-12-21T08:31:35.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = 9a03ceff-223f-46f2-a4b2-8c7e0e285bbd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
18932024-12-21T08:31:35.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = 9a03ceff-223f-46f2-a4b2-8c7e0e285bbd response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
18942024-12-21T08:31:35.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 075ff296-83ae-4d98-8dd4-de2c7e8231ec roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18952024-12-21T08:31:35.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 075ff296-83ae-4d98-8dd4-de2c7e8231ec resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18962024-12-21T08:31:35.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2637 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 075ff296-83ae-4d98-8dd4-de2c7e8231ec response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18972024-12-21T08:31:36.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2fab21ec-5fed-459f-94dd-e8efbdba8491 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18982024-12-21T08:31:36.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2fab21ec-5fed-459f-94dd-e8efbdba8491 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
18992024-12-21T08:31:36.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2fab21ec-5fed-459f-94dd-e8efbdba8491 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19002024-12-21T08:31:37.165ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:64538
19012024-12-21T08:31:37.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64538 req_id = 67631374-15d7-4764-82bb-f7ac36079188 roles = RoleSet { roles: {} } uri = /metrics/producers
19022024-12-21T08:31:37.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64538 req_id = 67631374-15d7-4764-82bb-f7ac36079188 resource = Database result = Ok(()) uri = /metrics/producers
19032024-12-21T08:31:37.217ZINFOnexus: assigned collector to new producer collector_id = d3e17b73-750a-4d54-b6e9-cb13b0984ebb file = nexus/src/app/oximeter.rs:76 producer_id = 41e6f272-71a8-4e23-be23-2506b7b8fb0f
19042024-12-21T08:31:37.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51733 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64538 req_id = 67631374-15d7-4764-82bb-f7ac36079188 response_code = 201 uri = /metrics/producers
19052024-12-21T08:31:37.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 283822c9-1510-4dc8-beb5-152a180be454 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19062024-12-21T08:31:37.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 283822c9-1510-4dc8-beb5-152a180be454 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19072024-12-21T08:31:37.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 283822c9-1510-4dc8-beb5-152a180be454 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19082024-12-21T08:31:39.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 348c5afe-d56e-4bfb-80a0-f61e85c7e7e8 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19092024-12-21T08:31:39.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 348c5afe-d56e-4bfb-80a0-f61e85c7e7e8 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19102024-12-21T08:31:39.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2763 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 348c5afe-d56e-4bfb-80a0-f61e85c7e7e8 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19112024-12-21T08:31:40.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f1710dc1-9472-44b7-8bca-630cd363a095 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19122024-12-21T08:31:40.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f1710dc1-9472-44b7-8bca-630cd363a095 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19132024-12-21T08:31:40.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f1710dc1-9472-44b7-8bca-630cd363a095 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19142024-12-21T08:31:41.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 63cf54f8-2387-4476-bc94-98bd2f9134f9 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19152024-12-21T08:31:41.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 63cf54f8-2387-4476-bc94-98bd2f9134f9 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19162024-12-21T08:31:41.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 63cf54f8-2387-4476-bc94-98bd2f9134f9 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19172024-12-21T08:31:41.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
19182024-12-21T08:31:41.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
19192024-12-21T08:31:41.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19202024-12-21T08:31:41.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19212024-12-21T08:31:41.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19222024-12-21T08:31:41.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19232024-12-21T08:31:41.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19242024-12-21T08:31:41.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19252024-12-21T08:31:41.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19262024-12-21T08:31:41.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19272024-12-21T08:31:41.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19282024-12-21T08:31:41.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19292024-12-21T08:31:41.536ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.034384ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19302024-12-21T08:31:41.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19312024-12-21T08:31:41.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19322024-12-21T08:31:41.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19332024-12-21T08:31:41.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
19342024-12-21T08:31:41.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19352024-12-21T08:31:41.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19362024-12-21T08:31:41.550ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
19372024-12-21T08:31:41.550ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.774584ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
19382024-12-21T08:31:42.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0596b2a0-488d-427f-b2fb-dcb195ac9d15 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19392024-12-21T08:31:42.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0596b2a0-488d-427f-b2fb-dcb195ac9d15 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19402024-12-21T08:31:42.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0596b2a0-488d-427f-b2fb-dcb195ac9d15 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19412024-12-21T08:31:43.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ffec07be-b29c-4819-a169-e9fda7b4d512 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19422024-12-21T08:31:43.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ffec07be-b29c-4819-a169-e9fda7b4d512 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19432024-12-21T08:31:43.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ffec07be-b29c-4819-a169-e9fda7b4d512 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19442024-12-21T08:31:44.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4aa7a61d-abfc-4fbc-abdc-6223d2399b51 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19452024-12-21T08:31:44.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4aa7a61d-abfc-4fbc-abdc-6223d2399b51 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19462024-12-21T08:31:44.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2768 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4aa7a61d-abfc-4fbc-abdc-6223d2399b51 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19472024-12-21T08:31:44.532ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1345 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = facbd55f-40dc-45af-a475-c30eebeb1a19 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
19482024-12-21T08:31:45.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7a0d2848-61b9-4328-9667-fad592b27255 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19492024-12-21T08:31:45.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7a0d2848-61b9-4328-9667-fad592b27255 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19502024-12-21T08:31:45.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7a0d2848-61b9-4328-9667-fad592b27255 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19512024-12-21T08:31:46.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = af9a88b6-9de4-4933-a94e-ba01dbdaccfb roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19522024-12-21T08:31:46.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = af9a88b6-9de4-4933-a94e-ba01dbdaccfb resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19532024-12-21T08:31:46.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = af9a88b6-9de4-4933-a94e-ba01dbdaccfb response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19542024-12-21T08:31:47.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d7ba3fff-95ef-4a69-97b8-9d6dea44cc79 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19552024-12-21T08:31:47.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d7ba3fff-95ef-4a69-97b8-9d6dea44cc79 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19562024-12-21T08:31:47.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d7ba3fff-95ef-4a69-97b8-9d6dea44cc79 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19572024-12-21T08:31:47.728ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35477
19582024-12-21T08:31:47.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35477 req_id = 534b45cb-45d0-4548-9102-b909b522b240 roles = RoleSet { roles: {} } uri = /metrics/producers
19592024-12-21T08:31:47.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35477 req_id = 534b45cb-45d0-4548-9102-b909b522b240 resource = Database result = Ok(()) uri = /metrics/producers
19602024-12-21T08:31:47.738ZINFOnexus: assigned collector to new producer collector_id = d3e17b73-750a-4d54-b6e9-cb13b0984ebb file = nexus/src/app/oximeter.rs:76 producer_id = 25f39d10-483e-499e-9f49-442290f3e1ab
19612024-12-21T08:31:47.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9927 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35477 req_id = 534b45cb-45d0-4548-9102-b909b522b240 response_code = 201 uri = /metrics/producers
19622024-12-21T08:31:48.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ee455f6e-cd11-4fd9-88fc-6c1514012663 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19632024-12-21T08:31:48.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ee455f6e-cd11-4fd9-88fc-6c1514012663 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19642024-12-21T08:31:48.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2673 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ee455f6e-cd11-4fd9-88fc-6c1514012663 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19652024-12-21T08:31:49.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ed4a4e73-7b59-4ea8-afe7-796f6251978d roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19662024-12-21T08:31:49.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ed4a4e73-7b59-4ea8-afe7-796f6251978d resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19672024-12-21T08:31:49.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ed4a4e73-7b59-4ea8-afe7-796f6251978d response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19682024-12-21T08:31:50.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 334ed763-c534-4a72-a73f-0fdf6442ed85 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19692024-12-21T08:31:50.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 334ed763-c534-4a72-a73f-0fdf6442ed85 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19702024-12-21T08:31:50.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2704 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 334ed763-c534-4a72-a73f-0fdf6442ed85 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19712024-12-21T08:31:51.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7033beec-eb82-48a9-968e-a8e3fe6051e7 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19722024-12-21T08:31:51.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7033beec-eb82-48a9-968e-a8e3fe6051e7 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19732024-12-21T08:31:51.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7033beec-eb82-48a9-968e-a8e3fe6051e7 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
19742024-12-21T08:31:51.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
19752024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19762024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
19772024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
19782024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19792024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19802024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
19812024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19822024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
19832024-12-21T08:31:51.532ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19842024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
19852024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19862024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
19872024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19882024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19892024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
19902024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19912024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19922024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
19932024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19942024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
19952024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
19962024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
19972024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19982024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19992024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
20002024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
20012024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20022024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
20032024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20042024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20052024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
20062024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20072024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
20082024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
20092024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20102024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
20112024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20122024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20132024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
20142024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20152024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20162024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20172024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20182024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20192024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20202024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20212024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20222024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20232024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20242024-12-21T08:31:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20252024-12-21T08:31:51.535ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1793, tv_nsec: 523459211 } })
20262024-12-21T08:31:51.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20272024-12-21T08:31:51.535ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
20282024-12-21T08:31:51.535ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.605302ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20292024-12-21T08:31:51.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1793, tv_nsec: 525046605 } })
20302024-12-21T08:31:51.537ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20312024-12-21T08:31:51.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
20322024-12-21T08:31:51.537ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20332024-12-21T08:31:51.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20342024-12-21T08:31:51.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20352024-12-21T08:31:51.538ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20362024-12-21T08:31:51.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20372024-12-21T08:31:51.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20382024-12-21T08:31:51.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20392024-12-21T08:31:51.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20402024-12-21T08:31:51.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20412024-12-21T08:31:51.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20422024-12-21T08:31:51.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20432024-12-21T08:31:51.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20442024-12-21T08:31:51.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20452024-12-21T08:31:51.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20462024-12-21T08:31:51.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20472024-12-21T08:31:51.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20482024-12-21T08:31:51.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20492024-12-21T08:31:51.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20502024-12-21T08:31:51.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20512024-12-21T08:31:51.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20522024-12-21T08:31:51.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20532024-12-21T08:31:51.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20542024-12-21T08:31:51.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20552024-12-21T08:31:51.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20562024-12-21T08:31:51.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20572024-12-21T08:31:51.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.182656ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
20582024-12-21T08:31:51.546ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20592024-12-21T08:31:51.546ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20602024-12-21T08:31:51.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20612024-12-21T08:31:51.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20622024-12-21T08:31:51.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20632024-12-21T08:31:51.547ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.157114ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20642024-12-21T08:31:51.547ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20652024-12-21T08:31:51.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20662024-12-21T08:31:51.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20672024-12-21T08:31:51.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20682024-12-21T08:31:51.549ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1793, tv_nsec: 537188522 } })
20692024-12-21T08:31:51.549ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
20702024-12-21T08:31:51.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20712024-12-21T08:31:51.550ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20722024-12-21T08:31:51.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20732024-12-21T08:31:51.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20742024-12-21T08:31:51.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20752024-12-21T08:31:51.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20762024-12-21T08:31:51.552ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20772024-12-21T08:31:51.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20782024-12-21T08:31:51.553ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20792024-12-21T08:31:51.553ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.807333ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20802024-12-21T08:31:51.572ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 40.132034ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
20812024-12-21T08:31:51.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20822024-12-21T08:31:51.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20832024-12-21T08:31:51.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20842024-12-21T08:31:51.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20852024-12-21T08:31:51.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20862024-12-21T08:31:51.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20872024-12-21T08:31:51.577ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20882024-12-21T08:31:51.577ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20892024-12-21T08:31:51.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20902024-12-21T08:31:51.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20912024-12-21T08:31:51.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 50.469075ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20922024-12-21T08:31:51.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20932024-12-21T08:31:51.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
20942024-12-21T08:31:51.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20952024-12-21T08:31:51.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20962024-12-21T08:31:51.644ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20972024-12-21T08:31:51.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20982024-12-21T08:31:51.652ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
20992024-12-21T08:31:51.652ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21002024-12-21T08:31:51.652ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c981084-6dec-4d61-abad-4bdd6d648e84", "content-length": "26", "date": "Sat, 21 Dec 2024 08:31:51 GMT"} })
21012024-12-21T08:31:51.652ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21022024-12-21T08:31:51.654ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21032024-12-21T08:31:51.658ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 126.089662ms iteration = 32 status = {"physical_disks_added":0}
21042024-12-21T08:31:51.663ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 zone_address = fd00:1122:3344:101::2
21052024-12-21T08:31:51.663ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21062024-12-21T08:31:51.663ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "658b9973-cc55-43ad-b220-77ea77dea8b7", "content-length": "26", "date": "Sat, 21 Dec 2024 08:31:51 GMT"} })
21072024-12-21T08:31:51.663ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21082024-12-21T08:31:51.665ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
21092024-12-21T08:31:51.730ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21102024-12-21T08:31:51.730ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21112024-12-21T08:31:51.731ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d14bd5a3-6d19-4572-ae12-bfe66b42b295", "content-length": "26", "date": "Sat, 21 Dec 2024 08:31:51 GMT"} })
21122024-12-21T08:31:51.731ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21132024-12-21T08:31:51.732ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21142024-12-21T08:31:51.758ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21152024-12-21T08:31:51.758ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21162024-12-21T08:31:51.758ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc442c8f-f794-4063-bc10-fa5169457da3", "content-length": "372", "date": "Sat, 21 Dec 2024 08:31:51 GMT"} })
21172024-12-21T08:31:51.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21182024-12-21T08:31:51.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21192024-12-21T08:31:51.760ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21202024-12-21T08:31:51.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21212024-12-21T08:31:51.762ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21222024-12-21T08:31:51.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3b53ba2d-4d00-44a6-bd37-8306adc194ea, lookup_type: ById(3b53ba2d-4d00-44a6-bd37-8306adc194ea) } result = Ok(())
21232024-12-21T08:31:51.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21242024-12-21T08:31:51.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21252024-12-21T08:31:51.766ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 234.824411ms iteration = 28 status = 0
21262024-12-21T08:31:51.769ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
21272024-12-21T08:31:51.769ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 237.297444ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
21282024-12-21T08:31:51.788ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 256.040389ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
21292024-12-21T08:31:51.788ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21302024-12-21T08:31:51.788ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21312024-12-21T08:31:51.788ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21322024-12-21T08:31:51.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21332024-12-21T08:31:51.790ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 258.157157ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21342024-12-21T08:31:51.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21352024-12-21T08:31:51.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21362024-12-21T08:31:51.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21372024-12-21T08:31:51.802ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21382024-12-21T08:31:51.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21392024-12-21T08:31:51.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21402024-12-21T08:31:51.804ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21412024-12-21T08:31:51.805ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21422024-12-21T08:31:51.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21432024-12-21T08:31:51.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21442024-12-21T08:31:51.806ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
21452024-12-21T08:31:51.806ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21462024-12-21T08:31:51.807ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "415f35cd-06a9-411a-a765-5f5a420eef1e", "date": "Sat, 21 Dec 2024 08:31:51 GMT"} })
21472024-12-21T08:31:51.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21482024-12-21T08:31:51.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21492024-12-21T08:31:51.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21502024-12-21T08:31:51.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21512024-12-21T08:31:51.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21522024-12-21T08:31:51.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21532024-12-21T08:31:51.814ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
21542024-12-21T08:31:51.814ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21552024-12-21T08:31:51.814ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3bf84341-db9c-4c70-aab1-3ec22ea8254d", "date": "Sat, 21 Dec 2024 08:31:51 GMT"} })
21562024-12-21T08:31:51.817ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 285.214486ms iteration = 30 status = {}
21572024-12-21T08:31:51.824ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21582024-12-21T08:31:51.824ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21592024-12-21T08:31:51.824ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 292.296638ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21602024-12-21T08:31:51.851ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
21612024-12-21T08:31:51.851ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "272ae3eb-f8ed-466a-9915-6f0d2a854823", "content-length": "2", "date": "Sat, 21 Dec 2024 08:31:51 GMT"} })
21622024-12-21T08:31:51.853ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21632024-12-21T08:31:51.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21642024-12-21T08:31:51.854ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 322.962269ms iteration = 28 status = null
21652024-12-21T08:31:51.861ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 329.529106ms iteration = 28 status = {}
21662024-12-21T08:31:51.893ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21672024-12-21T08:31:51.893ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "437145a3-62bd-4292-b0a2-633954e4f117", "content-length": "691", "date": "Sat, 21 Dec 2024 08:31:51 GMT"} })
21682024-12-21T08:31:51.893ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
21692024-12-21T08:31:51.893ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
21702024-12-21T08:31:51.893ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
21712024-12-21T08:31:51.895ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 362.87232ms iteration = 29 status = {}
21722024-12-21T08:31:51.951ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21732024-12-21T08:31:51.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21742024-12-21T08:31:51.955ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4986737f-c249-4380-901f-c7ce67751b89, rack_id: dcff325a-cbfd-4a8c-805a-d5b8a1a42707, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a98489e0-d62f-4837-a1f0-df124db3049c) } rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0
21752024-12-21T08:31:51.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21762024-12-21T08:31:51.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21772024-12-21T08:31:51.963ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
21782024-12-21T08:31:51.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fa4533e-5838-4323-a393-8803765b252c", "content-length": "134", "date": "Sat, 21 Dec 2024 08:31:51 GMT"} })
21792024-12-21T08:31:51.964ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
21802024-12-21T08:31:51.964ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a98489e0-d62f-4837-a1f0-df124db3049c
21812024-12-21T08:31:51.964ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
21822024-12-21T08:31:51.964ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21832024-12-21T08:31:51.964ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21842024-12-21T08:31:51.964ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21852024-12-21T08:31:51.964ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21862024-12-21T08:31:51.964ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21872024-12-21T08:31:51.964ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21882024-12-21T08:31:51.964ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21892024-12-21T08:31:51.965ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
21902024-12-21T08:31:51.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21912024-12-21T08:31:51.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21922024-12-21T08:31:51.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
21932024-12-21T08:31:51.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dc16841-35f2-408c-95e3-b5fa29ba6007", "content-length": "2", "date": "Sat, 21 Dec 2024 08:31:51 GMT"} })
21942024-12-21T08:31:51.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
21952024-12-21T08:31:51.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f54c504-382a-41b1-bd7f-130d49ba0129", "content-length": "52", "date": "Sat, 21 Dec 2024 08:31:51 GMT"} })
21962024-12-21T08:31:51.967ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0
21972024-12-21T08:31:51.967ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
21982024-12-21T08:31:52.103ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8a8bd076-9e1c-487c-ad78-9ae74bb2dd0a", "date": "Sat, 21 Dec 2024 08:31:51 GMT"} })
21992024-12-21T08:31:52.103ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch = Switch0
22002024-12-21T08:31:52.103ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22012024-12-21T08:31:52.103ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e36115b-4643-414b-b253-7caaf542d9b6", "content-length": "682", "date": "Sat, 21 Dec 2024 08:31:52 GMT"} })
22022024-12-21T08:31:52.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22032024-12-21T08:31:52.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22042024-12-21T08:31:52.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22052024-12-21T08:31:52.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22062024-12-21T08:31:52.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22072024-12-21T08:31:52.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22082024-12-21T08:31:52.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22092024-12-21T08:31:52.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22102024-12-21T08:31:52.120ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 588.37972ms iteration = 28 status = {}
22112024-12-21T08:31:52.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0179c51d-bb0b-4ac2-b829-1e6a5c258bcd roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22122024-12-21T08:31:52.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0179c51d-bb0b-4ac2-b829-1e6a5c258bcd resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22132024-12-21T08:31:52.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1823 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0179c51d-bb0b-4ac2-b829-1e6a5c258bcd response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22142024-12-21T08:31:53.033ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:47911
22152024-12-21T08:31:53.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47911 req_id = f2b5c59b-17fe-4f57-b029-ed89002ca3a9 roles = RoleSet { roles: {} } uri = /metrics/producers
22162024-12-21T08:31:53.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47911 req_id = f2b5c59b-17fe-4f57-b029-ed89002ca3a9 resource = Database result = Ok(()) uri = /metrics/producers
22172024-12-21T08:31:53.046ZINFOnexus: assigned collector to new producer collector_id = d3e17b73-750a-4d54-b6e9-cb13b0984ebb file = nexus/src/app/oximeter.rs:76 producer_id = 637dbf26-b3a6-4754-bd7f-359f775576b5
22182024-12-21T08:31:53.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12417 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47911 req_id = f2b5c59b-17fe-4f57-b029-ed89002ca3a9 response_code = 201 uri = /metrics/producers
22192024-12-21T08:31:53.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 57e9ad5a-2ef0-4e0f-98a3-f0f80376a52f roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22202024-12-21T08:31:53.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 57e9ad5a-2ef0-4e0f-98a3-f0f80376a52f resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22212024-12-21T08:31:53.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 57e9ad5a-2ef0-4e0f-98a3-f0f80376a52f response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22222024-12-21T08:31:54.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 31ca3840-0e6c-4cde-a394-dec11ac4cd63 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22232024-12-21T08:31:54.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 31ca3840-0e6c-4cde-a394-dec11ac4cd63 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22242024-12-21T08:31:54.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 31ca3840-0e6c-4cde-a394-dec11ac4cd63 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22252024-12-21T08:31:54.532ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1368 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = e9f8903e-218f-4fba-a57c-f1edd941c2f8 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
22262024-12-21T08:31:54.899ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:36285
22272024-12-21T08:31:54.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36285 req_id = 97a42a82-9318-4ed8-9a77-a56e74aaf548 roles = RoleSet { roles: {} } uri = /metrics/producers
22282024-12-21T08:31:54.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36285 req_id = 97a42a82-9318-4ed8-9a77-a56e74aaf548 resource = Database result = Ok(()) uri = /metrics/producers
22292024-12-21T08:31:54.910ZINFOnexus: assigned collector to new producer collector_id = d3e17b73-750a-4d54-b6e9-cb13b0984ebb file = nexus/src/app/oximeter.rs:76 producer_id = b72ebc94-c32b-4dad-bd39-b36503bae11c
22302024-12-21T08:31:54.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11024 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36285 req_id = 97a42a82-9318-4ed8-9a77-a56e74aaf548 response_code = 201 uri = /metrics/producers
22312024-12-21T08:31:55.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7ae5afb9-846b-409f-9596-60f4cd7e87f3 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22322024-12-21T08:31:55.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7ae5afb9-846b-409f-9596-60f4cd7e87f3 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22332024-12-21T08:31:55.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7ae5afb9-846b-409f-9596-60f4cd7e87f3 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22342024-12-21T08:31:56.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 283158ee-294c-4eb2-9c39-5c6b36b85575 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22352024-12-21T08:31:56.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 283158ee-294c-4eb2-9c39-5c6b36b85575 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22362024-12-21T08:31:56.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 283158ee-294c-4eb2-9c39-5c6b36b85575 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22372024-12-21T08:31:57.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7fafc987-cb3f-4106-9ba2-261673039ebb roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22382024-12-21T08:31:57.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7fafc987-cb3f-4106-9ba2-261673039ebb resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22392024-12-21T08:31:57.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7fafc987-cb3f-4106-9ba2-261673039ebb response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22402024-12-21T08:31:58.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 80e2f528-1bce-4f57-a555-3392ac3d264c roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22412024-12-21T08:31:58.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 80e2f528-1bce-4f57-a555-3392ac3d264c resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22422024-12-21T08:31:58.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 80e2f528-1bce-4f57-a555-3392ac3d264c response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22432024-12-21T08:31:59.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0851b846-5a0e-4d71-bc60-cfb560a155f8 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22442024-12-21T08:31:59.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0851b846-5a0e-4d71-bc60-cfb560a155f8 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22452024-12-21T08:31:59.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0851b846-5a0e-4d71-bc60-cfb560a155f8 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22462024-12-21T08:32:00.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0f061dad-60c4-4070-8ff2-2042660a1ded roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22472024-12-21T08:32:00.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0f061dad-60c4-4070-8ff2-2042660a1ded resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22482024-12-21T08:32:00.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0f061dad-60c4-4070-8ff2-2042660a1ded response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22492024-12-21T08:32:01.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 45997551-c344-4d2d-903b-f853da147b13 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22502024-12-21T08:32:01.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 45997551-c344-4d2d-903b-f853da147b13 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22512024-12-21T08:32:01.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 45997551-c344-4d2d-903b-f853da147b13 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22522024-12-21T08:32:01.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
22532024-12-21T08:32:01.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
22542024-12-21T08:32:01.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22552024-12-21T08:32:01.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22562024-12-21T08:32:01.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22572024-12-21T08:32:01.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22582024-12-21T08:32:01.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22592024-12-21T08:32:01.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22602024-12-21T08:32:01.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22612024-12-21T08:32:01.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22622024-12-21T08:32:01.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22632024-12-21T08:32:01.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22642024-12-21T08:32:01.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22652024-12-21T08:32:01.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
22662024-12-21T08:32:01.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22672024-12-21T08:32:01.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22682024-12-21T08:32:01.552ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
22692024-12-21T08:32:01.552ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.346649ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
22702024-12-21T08:32:01.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22712024-12-21T08:32:01.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22722024-12-21T08:32:01.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.810373ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22732024-12-21T08:32:02.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b62272bd-7d71-4236-b115-a1cbf302d5f5 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22742024-12-21T08:32:02.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b62272bd-7d71-4236-b115-a1cbf302d5f5 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22752024-12-21T08:32:02.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b62272bd-7d71-4236-b115-a1cbf302d5f5 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22762024-12-21T08:32:03.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 020b2d33-9a3d-4600-a721-91e7b76dc57a roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22772024-12-21T08:32:03.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 020b2d33-9a3d-4600-a721-91e7b76dc57a resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22782024-12-21T08:32:03.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 020b2d33-9a3d-4600-a721-91e7b76dc57a response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22792024-12-21T08:32:04.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 8c9895c2-7cf6-4553-b037-3b5dd057fd4f roles = RoleSet { roles: {} } uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?sort_by=id_ascending
22802024-12-21T08:32:04.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 8c9895c2-7cf6-4553-b037-3b5dd057fd4f resource = Database result = Ok(()) uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?sort_by=id_ascending
22812024-12-21T08:32:04.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2826 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 8c9895c2-7cf6-4553-b037-3b5dd057fd4f response_code = 200 uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?sort_by=id_ascending
22822024-12-21T08:32:04.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 4d177865-2bba-4246-92b3-c78928f00381 roles = RoleSet { roles: {} } uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWY2MjFkYy01ODFkLTQ1Y2MtOGViYy05NGE0ZDIyN2NkZmIifX0%3D
22832024-12-21T08:32:04.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 4d177865-2bba-4246-92b3-c78928f00381 resource = Database result = Ok(()) uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWY2MjFkYy01ODFkLTQ1Y2MtOGViYy05NGE0ZDIyN2NkZmIifX0%3D
22842024-12-21T08:32:04.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2864 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44650 req_id = 4d177865-2bba-4246-92b3-c78928f00381 response_code = 200 uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWY2MjFkYy01ODFkLTQ1Y2MtOGViYy05NGE0ZDIyN2NkZmIifX0%3D
22852024-12-21T08:32:04.532ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = 97d1e7c9-7220-4549-94be-4f0ebb74a7fe response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
22862024-12-21T08:32:04.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 1a180e30-6116-4005-9e73-033c8308ec90 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22872024-12-21T08:32:04.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 1a180e30-6116-4005-9e73-033c8308ec90 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22882024-12-21T08:32:04.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 1a180e30-6116-4005-9e73-033c8308ec90 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22892024-12-21T08:32:05.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e7fe6e1d-add8-4df5-96f8-2442a07ac0ac roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22902024-12-21T08:32:05.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e7fe6e1d-add8-4df5-96f8-2442a07ac0ac resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22912024-12-21T08:32:05.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e7fe6e1d-add8-4df5-96f8-2442a07ac0ac response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22922024-12-21T08:32:05.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = d5ad9be7-7d4a-4b1a-afa9-08cb076ff9f1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
22932024-12-21T08:32:05.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = d5ad9be7-7d4a-4b1a-afa9-08cb076ff9f1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
22942024-12-21T08:32:05.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = d5ad9be7-7d4a-4b1a-afa9-08cb076ff9f1 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
22952024-12-21T08:32:06.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 56e7a567-ec1c-425b-b714-f57f8b46ea63 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22962024-12-21T08:32:06.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 56e7a567-ec1c-425b-b714-f57f8b46ea63 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22972024-12-21T08:32:06.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 56e7a567-ec1c-425b-b714-f57f8b46ea63 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22982024-12-21T08:32:07.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 1508c8a7-62f5-4771-856a-2500c31a8f04 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
22992024-12-21T08:32:07.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 1508c8a7-62f5-4771-856a-2500c31a8f04 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23002024-12-21T08:32:07.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 1508c8a7-62f5-4771-856a-2500c31a8f04 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23012024-12-21T08:32:08.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 32a8d060-8aa6-4988-8263-6744aa20f8ce roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23022024-12-21T08:32:08.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 32a8d060-8aa6-4988-8263-6744aa20f8ce resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23032024-12-21T08:32:08.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 32a8d060-8aa6-4988-8263-6744aa20f8ce response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23042024-12-21T08:32:09.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b027e839-0065-42bb-b4aa-9839f94695ad roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23052024-12-21T08:32:09.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b027e839-0065-42bb-b4aa-9839f94695ad resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23062024-12-21T08:32:09.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b027e839-0065-42bb-b4aa-9839f94695ad response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23072024-12-21T08:32:10.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = cf0a770d-8b85-47d5-969a-79197ee967ce roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23082024-12-21T08:32:10.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = cf0a770d-8b85-47d5-969a-79197ee967ce resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23092024-12-21T08:32:10.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = cf0a770d-8b85-47d5-969a-79197ee967ce response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23102024-12-21T08:32:11.413ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:45215
23112024-12-21T08:32:11.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45215 req_id = b6d886ef-ca1d-4763-b8f7-6c59437a0f1d roles = RoleSet { roles: {} } uri = /metrics/producers
23122024-12-21T08:32:11.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45215 req_id = b6d886ef-ca1d-4763-b8f7-6c59437a0f1d resource = Database result = Ok(()) uri = /metrics/producers
23132024-12-21T08:32:11.421ZINFOnexus: assigned collector to new producer collector_id = d3e17b73-750a-4d54-b6e9-cb13b0984ebb file = nexus/src/app/oximeter.rs:76 producer_id = 3b53ba2d-4d00-44a6-bd37-8306adc194ea
23142024-12-21T08:32:11.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7944 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45215 req_id = b6d886ef-ca1d-4763-b8f7-6c59437a0f1d response_code = 201 uri = /metrics/producers
23152024-12-21T08:32:11.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
23162024-12-21T08:32:11.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
23172024-12-21T08:32:11.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23182024-12-21T08:32:11.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23192024-12-21T08:32:11.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23202024-12-21T08:32:11.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23212024-12-21T08:32:11.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23222024-12-21T08:32:11.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23232024-12-21T08:32:11.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23242024-12-21T08:32:11.536ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.55921ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23252024-12-21T08:32:11.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23262024-12-21T08:32:11.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23272024-12-21T08:32:11.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23282024-12-21T08:32:11.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23292024-12-21T08:32:11.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23302024-12-21T08:32:11.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23312024-12-21T08:32:11.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
23322024-12-21T08:32:11.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23332024-12-21T08:32:11.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23342024-12-21T08:32:11.550ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
23352024-12-21T08:32:11.550ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.074139ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
23362024-12-21T08:32:11.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 426e02b7-d845-48d4-949e-67800f5ef129 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23372024-12-21T08:32:11.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 426e02b7-d845-48d4-949e-67800f5ef129 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23382024-12-21T08:32:11.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 426e02b7-d845-48d4-949e-67800f5ef129 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23392024-12-21T08:32:12.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a5ac36e2-4e02-43c7-9b62-328d38dfefb8 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23402024-12-21T08:32:12.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a5ac36e2-4e02-43c7-9b62-328d38dfefb8 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23412024-12-21T08:32:12.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a5ac36e2-4e02-43c7-9b62-328d38dfefb8 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23422024-12-21T08:32:13.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 8cc132b7-9283-421a-b5ff-be75fe4c7a0b roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23432024-12-21T08:32:13.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 8cc132b7-9283-421a-b5ff-be75fe4c7a0b resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23442024-12-21T08:32:13.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 8cc132b7-9283-421a-b5ff-be75fe4c7a0b response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23452024-12-21T08:32:14.531ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1328 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = 29b66c11-4bc4-4088-8418-d305fb03ee62 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
23462024-12-21T08:32:14.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 99b7f518-1feb-4813-9e71-9addc22fd443 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23472024-12-21T08:32:14.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 99b7f518-1feb-4813-9e71-9addc22fd443 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23482024-12-21T08:32:14.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1790 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 99b7f518-1feb-4813-9e71-9addc22fd443 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23492024-12-21T08:32:15.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ea042601-af52-4388-bf19-e5e9daadcef5 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23502024-12-21T08:32:15.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ea042601-af52-4388-bf19-e5e9daadcef5 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23512024-12-21T08:32:15.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ea042601-af52-4388-bf19-e5e9daadcef5 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23522024-12-21T08:32:16.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0dcd35bb-5897-45c1-9223-2fa02b120650 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23532024-12-21T08:32:16.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0dcd35bb-5897-45c1-9223-2fa02b120650 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23542024-12-21T08:32:16.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0dcd35bb-5897-45c1-9223-2fa02b120650 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23552024-12-21T08:32:17.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3fcd1d59-7f6f-4c89-adab-4fc7da0ea33c roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23562024-12-21T08:32:17.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3fcd1d59-7f6f-4c89-adab-4fc7da0ea33c resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23572024-12-21T08:32:17.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3fcd1d59-7f6f-4c89-adab-4fc7da0ea33c response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23582024-12-21T08:32:18.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 32a0fece-290a-4073-bae4-ae8a3e557daf roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23592024-12-21T08:32:18.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 32a0fece-290a-4073-bae4-ae8a3e557daf resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23602024-12-21T08:32:18.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 32a0fece-290a-4073-bae4-ae8a3e557daf response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23612024-12-21T08:32:19.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 668813b3-d70e-48f7-b945-acb5e6425924 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23622024-12-21T08:32:19.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 668813b3-d70e-48f7-b945-acb5e6425924 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23632024-12-21T08:32:19.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 668813b3-d70e-48f7-b945-acb5e6425924 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23642024-12-21T08:32:20.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d3113cfa-4d6a-4af4-8b66-f5bc327fd1f6 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23652024-12-21T08:32:20.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d3113cfa-4d6a-4af4-8b66-f5bc327fd1f6 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23662024-12-21T08:32:20.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d3113cfa-4d6a-4af4-8b66-f5bc327fd1f6 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
23672024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
23682024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
23692024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23702024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
23712024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23722024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
23732024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
23742024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23752024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
23762024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
23772024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
23782024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
23792024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23802024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
23812024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23822024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
23832024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23842024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23852024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
23862024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23872024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
23882024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23892024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
23902024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
23912024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23922024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
23932024-12-21T08:32:21.532ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302
23942024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.96\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302"}
23952024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
23962024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
23972024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
23982024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
23992024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24002024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
24012024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24022024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
24032024-12-21T08:32:21.532ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 08:22:21.532260222 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
24042024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
24052024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
24062024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
24072024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
24082024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24092024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
24102024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24112024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
24122024-12-21T08:32:21.532ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
24132024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
24142024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24152024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24162024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
24172024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24182024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
24192024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24202024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
24212024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
24222024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24232024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
24242024-12-21T08:32:21.532ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
24252024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24262024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
24272024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24282024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
24292024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24302024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24312024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24322024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24332024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24342024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
24352024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
24362024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24372024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24382024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24392024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24402024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24412024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24422024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24432024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24442024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24452024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24462024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24472024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24482024-12-21T08:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24492024-12-21T08:32:21.532ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("35bcbd45-3578-45df-b73d-00c21093df02.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50a4d151-f70f-4790-a525-028d2812625b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bdf4fa9e-0938-4aac-903e-8935b21f0685.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bdf4fa9e-0938-4aac-903e-8935b21f0685.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1823, tv_nsec: 520568276 } })
24502024-12-21T08:32:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
24512024-12-21T08:32:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24522024-12-21T08:32:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24532024-12-21T08:32:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24542024-12-21T08:32:21.533ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5037fa1b-4769-431c-8e17-0ed172e6d4e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea826706-9f75-4635-8793-1730a859a368.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea826706-9f75-4635-8793-1730a859a368.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1823, tv_nsec: 520672006 } })
24552024-12-21T08:32:21.533ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
24562024-12-21T08:32:21.533ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.338942ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
24572024-12-21T08:32:21.533ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
24582024-12-21T08:32:21.533ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.277831ms iteration = 16 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
24592024-12-21T08:32:21.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.244988ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
24602024-12-21T08:32:21.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24612024-12-21T08:32:21.536ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24622024-12-21T08:32:21.536ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24632024-12-21T08:32:21.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24642024-12-21T08:32:21.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24652024-12-21T08:32:21.536ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24662024-12-21T08:32:21.536ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.55494ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24672024-12-21T08:32:21.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1823, tv_nsec: 524570761 } })
24682024-12-21T08:32:21.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
24692024-12-21T08:32:21.538ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.092084ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
24702024-12-21T08:32:21.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24712024-12-21T08:32:21.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24722024-12-21T08:32:21.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24732024-12-21T08:32:21.538ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
24742024-12-21T08:32:21.539ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
24752024-12-21T08:32:21.539ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 6.77033ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
24762024-12-21T08:32:21.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24772024-12-21T08:32:21.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24782024-12-21T08:32:21.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24792024-12-21T08:32:21.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24802024-12-21T08:32:21.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24812024-12-21T08:32:21.541ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1823, tv_nsec: 528968310 } })
24822024-12-21T08:32:21.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24832024-12-21T08:32:21.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24842024-12-21T08:32:21.541ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
24852024-12-21T08:32:21.542ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24862024-12-21T08:32:21.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24872024-12-21T08:32:21.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24882024-12-21T08:32:21.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24892024-12-21T08:32:21.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24902024-12-21T08:32:21.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24912024-12-21T08:32:21.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24922024-12-21T08:32:21.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24932024-12-21T08:32:21.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24942024-12-21T08:32:21.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24952024-12-21T08:32:21.544ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24962024-12-21T08:32:21.544ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24972024-12-21T08:32:21.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24982024-12-21T08:32:21.545ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24992024-12-21T08:32:21.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25002024-12-21T08:32:21.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25012024-12-21T08:32:21.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25022024-12-21T08:32:21.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25032024-12-21T08:32:21.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25042024-12-21T08:32:21.547ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25052024-12-21T08:32:21.548ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 08:22:21.532260222 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
25062024-12-21T08:32:21.548ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 16.030292ms iteration = 15 status = {"expiration":"2024-12-21T08:22:21.532260222Z","pruned":[]}
25072024-12-21T08:32:21.548ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25082024-12-21T08:32:21.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25092024-12-21T08:32:21.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25102024-12-21T08:32:21.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
25112024-12-21T08:32:21.549ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
25122024-12-21T08:32:21.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
25132024-12-21T08:32:21.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25142024-12-21T08:32:21.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25152024-12-21T08:32:21.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25162024-12-21T08:32:21.555ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25172024-12-21T08:32:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25182024-12-21T08:32:21.557ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.061541ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25192024-12-21T08:32:21.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25202024-12-21T08:32:21.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25212024-12-21T08:32:21.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25222024-12-21T08:32:21.558ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25232024-12-21T08:32:21.558ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25242024-12-21T08:32:21.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25252024-12-21T08:32:21.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25262024-12-21T08:32:21.558ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
25272024-12-21T08:32:21.558ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
25282024-12-21T08:32:21.558ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
25292024-12-21T08:32:21.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25302024-12-21T08:32:21.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25312024-12-21T08:32:21.559ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25322024-12-21T08:32:21.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25332024-12-21T08:32:21.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25342024-12-21T08:32:21.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25352024-12-21T08:32:21.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25362024-12-21T08:32:21.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25372024-12-21T08:32:21.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25382024-12-21T08:32:21.562ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 30.194616ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25392024-12-21T08:32:21.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25402024-12-21T08:32:21.562ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1823, tv_nsec: 550525260 } })
25412024-12-21T08:32:21.563ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
25422024-12-21T08:32:21.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25432024-12-21T08:32:21.564ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25442024-12-21T08:32:21.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25452024-12-21T08:32:21.564ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25462024-12-21T08:32:21.564ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25472024-12-21T08:32:21.564ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 32.635548ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25482024-12-21T08:32:21.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25492024-12-21T08:32:21.565ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25502024-12-21T08:32:21.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25512024-12-21T08:32:21.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
25522024-12-21T08:32:21.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25532024-12-21T08:32:21.566ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25542024-12-21T08:32:21.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25552024-12-21T08:32:21.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25562024-12-21T08:32:21.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25572024-12-21T08:32:21.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25582024-12-21T08:32:21.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
25592024-12-21T08:32:21.568ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25602024-12-21T08:32:21.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25612024-12-21T08:32:21.570ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25622024-12-21T08:32:21.571ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
25632024-12-21T08:32:21.571ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 825f8681-b5f6-43ad-8053-b0be9965d93d dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
25642024-12-21T08:32:21.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25652024-12-21T08:32:21.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25662024-12-21T08:32:21.571ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25672024-12-21T08:32:21.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25682024-12-21T08:32:21.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25692024-12-21T08:32:21.573ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25702024-12-21T08:32:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25712024-12-21T08:32:21.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25722024-12-21T08:32:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25732024-12-21T08:32:21.578ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25742024-12-21T08:32:21.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25752024-12-21T08:32:21.585ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
25762024-12-21T08:32:21.585ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.409651ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
25772024-12-21T08:32:21.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25782024-12-21T08:32:21.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25792024-12-21T08:32:21.596ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25802024-12-21T08:32:21.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25812024-12-21T08:32:21.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.901331ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
25822024-12-21T08:32:21.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25832024-12-21T08:32:21.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25842024-12-21T08:32:21.603ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25852024-12-21T08:32:21.603ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 71.103978ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25862024-12-21T08:32:21.604ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
25872024-12-21T08:32:21.604ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
25882024-12-21T08:32:21.604ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.218767ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
25892024-12-21T08:32:21.605ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
25902024-12-21T08:32:21.605ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
25912024-12-21T08:32:21.605ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
25922024-12-21T08:32:21.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25932024-12-21T08:32:21.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25942024-12-21T08:32:21.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
25952024-12-21T08:32:21.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
25962024-12-21T08:32:21.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25972024-12-21T08:32:21.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25982024-12-21T08:32:21.677ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
25992024-12-21T08:32:21.677ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26002024-12-21T08:32:21.677ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "81e09e3c-f8c4-490e-aaa8-e83d3de19ec7", "content-length": "26", "date": "Sat, 21 Dec 2024 08:32:21 GMT"} })
26012024-12-21T08:32:21.677ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26022024-12-21T08:32:21.680ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26032024-12-21T08:32:21.684ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26042024-12-21T08:32:21.690ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
26052024-12-21T08:32:21.722ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
26062024-12-21T08:32:21.722ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26072024-12-21T08:32:21.722ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db918315-29ae-4f7b-a2aa-a408223dd4fa", "content-length": "26", "date": "Sat, 21 Dec 2024 08:32:21 GMT"} })
26082024-12-21T08:32:21.722ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26092024-12-21T08:32:21.723ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26102024-12-21T08:32:21.836ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26112024-12-21T08:32:21.851ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26122024-12-21T08:32:21.852ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0034c183-7121-4d01-847e-23b20c7d204f", "content-length": "2", "date": "Sat, 21 Dec 2024 08:32:20 GMT"} })
26132024-12-21T08:32:21.853ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26142024-12-21T08:32:21.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26152024-12-21T08:32:21.869ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26162024-12-21T08:32:21.870ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "cae9265a-139e-466b-81c4-d6d844a7d141", "date": "Sat, 21 Dec 2024 08:32:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26172024-12-21T08:32:21.870ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26182024-12-21T08:32:21.871ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "bf55b2b5-04e6-455f-81a2-b29236486099", "date": "Sat, 21 Dec 2024 08:32:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26192024-12-21T08:32:21.871ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26202024-12-21T08:32:21.872ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26212024-12-21T08:32:21.872ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 340.549144ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26222024-12-21T08:32:21.892ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 zone_address = fd00:1122:3344:101::2
26232024-12-21T08:32:21.892ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26242024-12-21T08:32:21.892ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "884e8efd-1c56-4af2-892a-d8478319f8de", "content-length": "26", "date": "Sat, 21 Dec 2024 08:32:21 GMT"} })
26252024-12-21T08:32:21.892ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26262024-12-21T08:32:21.895ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
26272024-12-21T08:32:21.895ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26282024-12-21T08:32:21.895ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26292024-12-21T08:32:21.895ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "47f3d008-6a84-403c-93a6-dc94630e014d", "content-length": "372", "date": "Sat, 21 Dec 2024 08:32:21 GMT"} })
26302024-12-21T08:32:21.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26312024-12-21T08:32:21.896ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 363.85514ms iteration = 29 status = {}
26322024-12-21T08:32:21.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26332024-12-21T08:32:21.898ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 825f8681-b5f6-43ad-8053-b0be9965d93d dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
26342024-12-21T08:32:21.898ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
26352024-12-21T08:32:21.898ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 08:18:22.068410 UTC dns_group = internal generation = 1
26362024-12-21T08:32:21.898ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 366.483753ms iteration = 16 status = {"generation":1}
26372024-12-21T08:32:21.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26382024-12-21T08:32:21.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26392024-12-21T08:32:21.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26402024-12-21T08:32:21.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26412024-12-21T08:32:21.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26422024-12-21T08:32:21.903ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
26432024-12-21T08:32:21.903ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26442024-12-21T08:32:21.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26452024-12-21T08:32:21.905ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26462024-12-21T08:32:21.905ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26472024-12-21T08:32:21.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26482024-12-21T08:32:21.906ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 373.955159ms iteration = 29 status = null
26492024-12-21T08:32:21.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26502024-12-21T08:32:21.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26512024-12-21T08:32:21.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26522024-12-21T08:32:21.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26532024-12-21T08:32:21.911ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26542024-12-21T08:32:21.918ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26552024-12-21T08:32:21.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26562024-12-21T08:32:21.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26572024-12-21T08:32:21.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3b53ba2d-4d00-44a6-bd37-8306adc194ea, lookup_type: ById(3b53ba2d-4d00-44a6-bd37-8306adc194ea) } result = Ok(())
26582024-12-21T08:32:21.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26592024-12-21T08:32:21.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26602024-12-21T08:32:21.926ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 393.996515ms iteration = 29 status = 0
26612024-12-21T08:32:21.954ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 421.622019ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26622024-12-21T08:32:21.955ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26632024-12-21T08:32:21.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26642024-12-21T08:32:21.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = bec8e07e-6134-497e-ac79-c7eeb95f2aa7 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
26652024-12-21T08:32:21.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = bec8e07e-6134-497e-ac79-c7eeb95f2aa7 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
26662024-12-21T08:32:21.958ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 426.745964ms iteration = 33 status = {"physical_disks_added":0}
26672024-12-21T08:32:21.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = bec8e07e-6134-497e-ac79-c7eeb95f2aa7 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
26682024-12-21T08:32:21.962ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
26692024-12-21T08:32:21.963ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fb375fe7-b9c4-4490-bf8c-180eb6207fe7", "date": "Sat, 21 Dec 2024 08:32:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26702024-12-21T08:32:21.963ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26712024-12-21T08:32:21.965ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "75ace552-f244-40da-9242-90436d91184c", "date": "Sat, 21 Dec 2024 08:32:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26722024-12-21T08:32:21.965ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26732024-12-21T08:32:21.966ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "db0efd54-6bc1-4521-8fa2-04f4fdc3c28a", "date": "Sat, 21 Dec 2024 08:32:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26742024-12-21T08:32:21.966ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26752024-12-21T08:32:21.969ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26762024-12-21T08:32:21.969ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
26772024-12-21T08:32:21.969ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e0ed7f2-a28d-41ab-87a3-81b7138901c7 dns_zone_name = oxide.test found_so_far = 0 version = 2
26782024-12-21T08:32:21.969ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26792024-12-21T08:32:21.969ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 436.636441ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
26802024-12-21T08:32:21.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26812024-12-21T08:32:21.969ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T08:18:19.279666Z, time_modified: 2024-12-21T08:18:19.279666Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 36ce767e-8d13-48fc-b54f-25a543752b28, db_silo: Silo { identity: SiloIdentity { id: 36ce767e-8d13-48fc-b54f-25a543752b28, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T08:18:23.511483Z, time_modified: 2024-12-21T08:18:23.511483Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d4d3d1815f342882ad1c1687b3d9b611837e26888f379a800d2fbe2710458245" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 36ce767e-8d13-48fc-b54f-25a543752b28, db_silo: Silo { identity: SiloIdentity { id: 36ce767e-8d13-48fc-b54f-25a543752b28, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T08:18:23.511483Z, time_modified: 2024-12-21T08:18:23.511483Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d4d3d1815f342882ad1c1687b3d9b611837e26888f379a800d2fbe2710458245" }] }) }
26822024-12-21T08:32:21.969ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 437.56819ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"36ce767e-8d13-48fc-b54f-25a543752b28","tls_certs":["d4d3d1815f342882ad1c1687b3d9b611837e26888f379a800d2fbe2710458245"]}},"default_endpoint":{"silo_id":"36ce767e-8d13-48fc-b54f-25a543752b28","tls_certs":["d4d3d1815f342882ad1c1687b3d9b611837e26888f379a800d2fbe2710458245"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
26832024-12-21T08:32:21.999ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
26842024-12-21T08:32:22.000ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26852024-12-21T08:32:22.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26862024-12-21T08:32:22.000ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bcef7c29-8d36-475d-a14c-0c03d06fe41b", "date": "Sat, 21 Dec 2024 08:32:21 GMT"} })
26872024-12-21T08:32:22.000ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26882024-12-21T08:32:22.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26892024-12-21T08:32:22.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26902024-12-21T08:32:22.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26912024-12-21T08:32:22.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26922024-12-21T08:32:22.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 479.917973ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
26932024-12-21T08:32:22.012ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e0ed7f2-a28d-41ab-87a3-81b7138901c7 dns_zone_name = oxide.test found_so_far = 1 version = 2
26942024-12-21T08:32:22.012ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26952024-12-21T08:32:22.012ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 08:18:23.563952 UTC dns_group = external generation = 2
26962024-12-21T08:32:22.012ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 480.362457ms iteration = 16 status = {"generation":2}
26972024-12-21T08:32:22.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26982024-12-21T08:32:22.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26992024-12-21T08:32:22.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27002024-12-21T08:32:22.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27012024-12-21T08:32:22.025ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
27022024-12-21T08:32:22.025ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27032024-12-21T08:32:22.026ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "19683aac-374e-4e6c-b936-f161cc6b303b", "date": "Sat, 21 Dec 2024 08:32:21 GMT"} })
27042024-12-21T08:32:22.029ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 496.839172ms iteration = 31 status = {}
27052024-12-21T08:32:22.071ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
27062024-12-21T08:32:22.071ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 539.359348ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
27072024-12-21T08:32:22.103ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
27082024-12-21T08:32:22.103ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0669ba47-8db2-4a76-a7e6-fbb4026b851c", "content-length": "691", "date": "Sat, 21 Dec 2024 08:32:21 GMT"} })
27092024-12-21T08:32:22.103ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
27102024-12-21T08:32:22.103ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
27112024-12-21T08:32:22.103ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
27122024-12-21T08:32:22.106ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 574.244205ms iteration = 30 status = {}
27132024-12-21T08:32:22.119ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27142024-12-21T08:32:22.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27152024-12-21T08:32:22.122ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4986737f-c249-4380-901f-c7ce67751b89, rack_id: dcff325a-cbfd-4a8c-805a-d5b8a1a42707, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a98489e0-d62f-4837-a1f0-df124db3049c) } rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0
27162024-12-21T08:32:22.122ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27172024-12-21T08:32:22.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27182024-12-21T08:32:22.134ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27192024-12-21T08:32:22.134ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2e3b141-6f38-49da-b776-a5ac83154e59", "content-length": "134", "date": "Sat, 21 Dec 2024 08:32:21 GMT"} })
27202024-12-21T08:32:22.134ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
27212024-12-21T08:32:22.134ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a98489e0-d62f-4837-a1f0-df124db3049c
27222024-12-21T08:32:22.135ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27232024-12-21T08:32:22.135ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27242024-12-21T08:32:22.135ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27252024-12-21T08:32:22.135ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27262024-12-21T08:32:22.135ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27272024-12-21T08:32:22.135ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27282024-12-21T08:32:22.135ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27292024-12-21T08:32:22.135ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27302024-12-21T08:32:22.135ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
27312024-12-21T08:32:22.135ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27322024-12-21T08:32:22.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27332024-12-21T08:32:22.137ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27342024-12-21T08:32:22.137ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "175caa64-fc6a-4269-8c5a-8f5a32ceb10f", "content-length": "2", "date": "Sat, 21 Dec 2024 08:32:21 GMT"} })
27352024-12-21T08:32:22.137ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27362024-12-21T08:32:22.137ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "55072692-b4cc-43d1-8136-560e41c2771a", "content-length": "52", "date": "Sat, 21 Dec 2024 08:32:21 GMT"} })
27372024-12-21T08:32:22.138ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0
27382024-12-21T08:32:22.138ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27392024-12-21T08:32:22.257ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "18b85ec2-3089-43a6-8ef8-b831b2f6994d", "date": "Sat, 21 Dec 2024 08:32:22 GMT"} })
27402024-12-21T08:32:22.257ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch = Switch0
27412024-12-21T08:32:22.257ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27422024-12-21T08:32:22.257ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfd5573c-d010-4ca9-883b-071a71b50bc0", "content-length": "682", "date": "Sat, 21 Dec 2024 08:32:22 GMT"} })
27432024-12-21T08:32:22.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27442024-12-21T08:32:22.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27452024-12-21T08:32:22.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27462024-12-21T08:32:22.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27472024-12-21T08:32:22.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27482024-12-21T08:32:22.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27492024-12-21T08:32:22.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27502024-12-21T08:32:22.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27512024-12-21T08:32:22.278ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 746.433324ms iteration = 29 status = {}
27522024-12-21T08:32:22.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2622aa55-8d1a-44e9-8fd4-98d1e9ffd8e7 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27532024-12-21T08:32:22.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2622aa55-8d1a-44e9-8fd4-98d1e9ffd8e7 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27542024-12-21T08:32:22.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2622aa55-8d1a-44e9-8fd4-98d1e9ffd8e7 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27552024-12-21T08:32:24.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7f239f4d-b3fd-4c61-9799-01ee25134e07 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27562024-12-21T08:32:24.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7f239f4d-b3fd-4c61-9799-01ee25134e07 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27572024-12-21T08:32:24.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7f239f4d-b3fd-4c61-9799-01ee25134e07 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27582024-12-21T08:32:24.533ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1459 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = b77fd768-3904-4b1a-8063-8225cee035e4 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
27592024-12-21T08:32:25.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9324e75d-d00b-4b54-9301-374bc6370a26 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27602024-12-21T08:32:25.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9324e75d-d00b-4b54-9301-374bc6370a26 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27612024-12-21T08:32:25.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9324e75d-d00b-4b54-9301-374bc6370a26 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27622024-12-21T08:32:26.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a2e00d6c-df7c-4d89-986e-eaffd4039085 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27632024-12-21T08:32:26.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a2e00d6c-df7c-4d89-986e-eaffd4039085 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27642024-12-21T08:32:26.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a2e00d6c-df7c-4d89-986e-eaffd4039085 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27652024-12-21T08:32:27.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b22126c3-501f-4f04-b208-94471c246960 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27662024-12-21T08:32:27.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b22126c3-501f-4f04-b208-94471c246960 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27672024-12-21T08:32:27.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b22126c3-501f-4f04-b208-94471c246960 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27682024-12-21T08:32:28.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dedf0953-c796-4ff5-9f18-30a9d8905e85 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27692024-12-21T08:32:28.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dedf0953-c796-4ff5-9f18-30a9d8905e85 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27702024-12-21T08:32:28.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dedf0953-c796-4ff5-9f18-30a9d8905e85 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27712024-12-21T08:32:29.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 66b996cc-b0a3-43ce-88fe-6b6cedf91c80 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27722024-12-21T08:32:29.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 66b996cc-b0a3-43ce-88fe-6b6cedf91c80 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27732024-12-21T08:32:29.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 66b996cc-b0a3-43ce-88fe-6b6cedf91c80 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27742024-12-21T08:32:30.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 637fd256-dcd8-4780-853c-5df44f323ba5 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27752024-12-21T08:32:30.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 637fd256-dcd8-4780-853c-5df44f323ba5 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27762024-12-21T08:32:30.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 637fd256-dcd8-4780-853c-5df44f323ba5 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27772024-12-21T08:32:31.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c5ae2d9d-d91f-400b-8fcb-e8fd59e806f9 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27782024-12-21T08:32:31.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c5ae2d9d-d91f-400b-8fcb-e8fd59e806f9 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27792024-12-21T08:32:31.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2663 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c5ae2d9d-d91f-400b-8fcb-e8fd59e806f9 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
27802024-12-21T08:32:31.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
27812024-12-21T08:32:31.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
27822024-12-21T08:32:31.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27832024-12-21T08:32:31.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27842024-12-21T08:32:31.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27852024-12-21T08:32:31.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27862024-12-21T08:32:31.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27872024-12-21T08:32:31.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27882024-12-21T08:32:31.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27892024-12-21T08:32:31.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27902024-12-21T08:32:31.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27912024-12-21T08:32:31.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27922024-12-21T08:32:31.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27932024-12-21T08:32:31.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27942024-12-21T08:32:31.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27952024-12-21T08:32:31.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
27962024-12-21T08:32:31.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27972024-12-21T08:32:31.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27982024-12-21T08:32:31.584ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
27992024-12-21T08:32:31.584ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.807726ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
28002024-12-21T08:32:31.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.852009ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28012024-12-21T08:32:32.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = da035f8a-58d2-4fcd-8cc9-f8a0a448ab39 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28022024-12-21T08:32:32.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = da035f8a-58d2-4fcd-8cc9-f8a0a448ab39 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28032024-12-21T08:32:32.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = da035f8a-58d2-4fcd-8cc9-f8a0a448ab39 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28042024-12-21T08:32:33.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f1cf6b03-b219-4d5d-bca4-72a753220c79 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28052024-12-21T08:32:33.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f1cf6b03-b219-4d5d-bca4-72a753220c79 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28062024-12-21T08:32:33.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1832 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f1cf6b03-b219-4d5d-bca4-72a753220c79 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28072024-12-21T08:32:34.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f2cfcd94-68ea-47d6-be83-6653cbab0de4 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28082024-12-21T08:32:34.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f2cfcd94-68ea-47d6-be83-6653cbab0de4 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28092024-12-21T08:32:34.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f2cfcd94-68ea-47d6-be83-6653cbab0de4 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28102024-12-21T08:32:34.533ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = 9b03d9ce-263b-465d-9aa6-e26e17a21c43 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
28112024-12-21T08:32:35.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d59f66e9-a9de-4a9a-a6bd-0e4f03169522 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28122024-12-21T08:32:35.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d59f66e9-a9de-4a9a-a6bd-0e4f03169522 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28132024-12-21T08:32:35.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d59f66e9-a9de-4a9a-a6bd-0e4f03169522 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28142024-12-21T08:32:35.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = 1fd3236a-016d-49a1-abd5-e05d0d8e4c3d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
28152024-12-21T08:32:35.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = 1fd3236a-016d-49a1-abd5-e05d0d8e4c3d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
28162024-12-21T08:32:35.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3571 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = 1fd3236a-016d-49a1-abd5-e05d0d8e4c3d response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
28172024-12-21T08:32:36.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2839e535-e391-410a-b1be-859df0955dfb roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28182024-12-21T08:32:36.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2839e535-e391-410a-b1be-859df0955dfb resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28192024-12-21T08:32:36.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2850 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2839e535-e391-410a-b1be-859df0955dfb response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28202024-12-21T08:32:37.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = cb266725-b0af-4248-b83d-582cec4fc989 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28212024-12-21T08:32:37.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = cb266725-b0af-4248-b83d-582cec4fc989 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28222024-12-21T08:32:37.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = cb266725-b0af-4248-b83d-582cec4fc989 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28232024-12-21T08:32:38.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2056f060-1d50-4836-8690-5c31c130daa7 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28242024-12-21T08:32:38.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2056f060-1d50-4836-8690-5c31c130daa7 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28252024-12-21T08:32:38.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2726 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2056f060-1d50-4836-8690-5c31c130daa7 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28262024-12-21T08:32:39.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2a608dfa-8d06-4681-83d9-3837891699b5 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28272024-12-21T08:32:39.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2a608dfa-8d06-4681-83d9-3837891699b5 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28282024-12-21T08:32:39.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2a608dfa-8d06-4681-83d9-3837891699b5 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28292024-12-21T08:32:40.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6997d786-a309-4243-b4bb-575fee1e242d roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28302024-12-21T08:32:40.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6997d786-a309-4243-b4bb-575fee1e242d resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28312024-12-21T08:32:40.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6997d786-a309-4243-b4bb-575fee1e242d response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28322024-12-21T08:32:41.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e8b0ea13-8044-44ee-92fc-60299b54ce41 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28332024-12-21T08:32:41.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e8b0ea13-8044-44ee-92fc-60299b54ce41 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28342024-12-21T08:32:41.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e8b0ea13-8044-44ee-92fc-60299b54ce41 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28352024-12-21T08:32:41.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
28362024-12-21T08:32:41.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
28372024-12-21T08:32:41.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28382024-12-21T08:32:41.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28392024-12-21T08:32:41.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28402024-12-21T08:32:41.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28412024-12-21T08:32:41.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28422024-12-21T08:32:41.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28432024-12-21T08:32:41.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28442024-12-21T08:32:41.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28452024-12-21T08:32:41.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28462024-12-21T08:32:41.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28472024-12-21T08:32:41.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28482024-12-21T08:32:41.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
28492024-12-21T08:32:41.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28502024-12-21T08:32:41.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28512024-12-21T08:32:41.558ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
28522024-12-21T08:32:41.558ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.904668ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
28532024-12-21T08:32:41.567ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28542024-12-21T08:32:41.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28552024-12-21T08:32:41.569ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.48127ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28562024-12-21T08:32:42.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e82ca1c6-a231-42d9-be43-c86d1d418cd9 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28572024-12-21T08:32:42.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e82ca1c6-a231-42d9-be43-c86d1d418cd9 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28582024-12-21T08:32:42.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = e82ca1c6-a231-42d9-be43-c86d1d418cd9 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28592024-12-21T08:32:43.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ec3211e7-a7dc-40fa-ad79-37d5d22c052f roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28602024-12-21T08:32:43.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ec3211e7-a7dc-40fa-ad79-37d5d22c052f resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28612024-12-21T08:32:43.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ec3211e7-a7dc-40fa-ad79-37d5d22c052f response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28622024-12-21T08:32:44.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 78775bf6-b263-48ac-a02e-1599a027d346 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28632024-12-21T08:32:44.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 78775bf6-b263-48ac-a02e-1599a027d346 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28642024-12-21T08:32:44.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 78775bf6-b263-48ac-a02e-1599a027d346 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28652024-12-21T08:32:44.533ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1778 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = ce2bf271-c0fc-4abb-a179-5bfc10ec79dc response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
28662024-12-21T08:32:45.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 5ca661fd-e0fd-4208-9b4a-ddd30873f0fb roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28672024-12-21T08:32:45.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 5ca661fd-e0fd-4208-9b4a-ddd30873f0fb resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28682024-12-21T08:32:45.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2798 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 5ca661fd-e0fd-4208-9b4a-ddd30873f0fb response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28692024-12-21T08:32:46.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7edad840-fded-4bd5-aac6-6d2698c030f1 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28702024-12-21T08:32:46.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7edad840-fded-4bd5-aac6-6d2698c030f1 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28712024-12-21T08:32:46.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7edad840-fded-4bd5-aac6-6d2698c030f1 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28722024-12-21T08:32:47.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 73c8ebad-4cf9-4a43-bc3f-68ddd2a1b04d roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28732024-12-21T08:32:47.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 73c8ebad-4cf9-4a43-bc3f-68ddd2a1b04d resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28742024-12-21T08:32:47.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 73c8ebad-4cf9-4a43-bc3f-68ddd2a1b04d response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28752024-12-21T08:32:48.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0e28b1d8-c7b6-42d8-9e7f-cbc0692b2e6e roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28762024-12-21T08:32:48.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0e28b1d8-c7b6-42d8-9e7f-cbc0692b2e6e resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28772024-12-21T08:32:48.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 0e28b1d8-c7b6-42d8-9e7f-cbc0692b2e6e response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28782024-12-21T08:32:49.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b1bcf794-0cda-4e47-83e9-67ae37a032f6 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28792024-12-21T08:32:49.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b1bcf794-0cda-4e47-83e9-67ae37a032f6 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28802024-12-21T08:32:49.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b1bcf794-0cda-4e47-83e9-67ae37a032f6 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28812024-12-21T08:32:50.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c3346592-05e2-4ad1-a6b5-f84913c37e8f roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28822024-12-21T08:32:50.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c3346592-05e2-4ad1-a6b5-f84913c37e8f resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28832024-12-21T08:32:50.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c3346592-05e2-4ad1-a6b5-f84913c37e8f response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
28842024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
28852024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
28862024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28872024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28882024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
28892024-12-21T08:32:51.532ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28902024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28912024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
28922024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28932024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
28942024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
28952024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28962024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
28972024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28982024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28992024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
29002024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29012024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
29022024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29032024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
29042024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29052024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29062024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
29072024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29082024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
29092024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
29102024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
29112024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
29122024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29132024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29142024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29152024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
29162024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
29172024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29182024-12-21T08:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
29192024-12-21T08:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29202024-12-21T08:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29212024-12-21T08:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29222024-12-21T08:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29232024-12-21T08:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29242024-12-21T08:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29252024-12-21T08:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29262024-12-21T08:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29272024-12-21T08:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29282024-12-21T08:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29292024-12-21T08:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29302024-12-21T08:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29312024-12-21T08:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
29322024-12-21T08:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29332024-12-21T08:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29342024-12-21T08:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29352024-12-21T08:32:51.536ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.589862ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29362024-12-21T08:32:51.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29372024-12-21T08:32:51.537ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1853, tv_nsec: 524312629 } })
29382024-12-21T08:32:51.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
29392024-12-21T08:32:51.537ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29402024-12-21T08:32:51.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29412024-12-21T08:32:51.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29422024-12-21T08:32:51.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29432024-12-21T08:32:51.542ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29442024-12-21T08:32:51.542ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1853, tv_nsec: 529740877 } })
29452024-12-21T08:32:51.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29462024-12-21T08:32:51.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29472024-12-21T08:32:51.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29482024-12-21T08:32:51.542ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
29492024-12-21T08:32:51.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29502024-12-21T08:32:51.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29512024-12-21T08:32:51.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29522024-12-21T08:32:51.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29532024-12-21T08:32:51.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29542024-12-21T08:32:51.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29552024-12-21T08:32:51.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29562024-12-21T08:32:51.570ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29572024-12-21T08:32:51.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29582024-12-21T08:32:51.571ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29592024-12-21T08:32:51.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29602024-12-21T08:32:51.572ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29612024-12-21T08:32:51.572ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29622024-12-21T08:32:51.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29632024-12-21T08:32:51.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29642024-12-21T08:32:51.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29652024-12-21T08:32:51.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29662024-12-21T08:32:51.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29672024-12-21T08:32:51.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29682024-12-21T08:32:51.577ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29692024-12-21T08:32:51.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29702024-12-21T08:32:51.577ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29712024-12-21T08:32:51.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29722024-12-21T08:32:51.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29732024-12-21T08:32:51.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29742024-12-21T08:32:51.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29752024-12-21T08:32:51.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29762024-12-21T08:32:51.579ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29772024-12-21T08:32:51.579ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 46.619591ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29782024-12-21T08:32:51.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.327318ms iteration = 30 status = {"errors":[],"finish_invoked_ok":[]}
29792024-12-21T08:32:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29802024-12-21T08:32:51.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29812024-12-21T08:32:51.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29822024-12-21T08:32:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29832024-12-21T08:32:51.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29842024-12-21T08:32:51.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29852024-12-21T08:32:51.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29862024-12-21T08:32:51.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29872024-12-21T08:32:51.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29882024-12-21T08:32:51.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 49.87765ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
29892024-12-21T08:32:51.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29902024-12-21T08:32:51.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29912024-12-21T08:32:51.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29922024-12-21T08:32:51.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29932024-12-21T08:32:51.584ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1853, tv_nsec: 571164572 } })
29942024-12-21T08:32:51.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29952024-12-21T08:32:51.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.711467ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
29962024-12-21T08:32:51.584ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
29972024-12-21T08:32:51.589ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29982024-12-21T08:32:51.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29992024-12-21T08:32:51.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30002024-12-21T08:32:51.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.471457ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30012024-12-21T08:32:51.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
30022024-12-21T08:32:51.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30032024-12-21T08:32:51.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30042024-12-21T08:32:51.605ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
30052024-12-21T08:32:51.605ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30062024-12-21T08:32:51.605ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f87c77a4-5713-401c-981a-69e76b8fed39", "content-length": "26", "date": "Sat, 21 Dec 2024 08:32:51 GMT"} })
30072024-12-21T08:32:51.605ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30082024-12-21T08:32:51.605ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
30092024-12-21T08:32:51.606ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.202046ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
30102024-12-21T08:32:51.607ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30112024-12-21T08:32:51.607ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30122024-12-21T08:32:51.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30132024-12-21T08:32:51.607ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30142024-12-21T08:32:51.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30152024-12-21T08:32:51.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f27ec072-2bc0-4790-93fc-693031c8e4f3 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
30162024-12-21T08:32:51.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f27ec072-2bc0-4790-93fc-693031c8e4f3 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
30172024-12-21T08:32:51.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30182024-12-21T08:32:51.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30192024-12-21T08:32:51.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2697 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f27ec072-2bc0-4790-93fc-693031c8e4f3 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
30202024-12-21T08:32:51.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30212024-12-21T08:32:51.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30222024-12-21T08:32:51.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.157835ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30232024-12-21T08:32:51.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.14693ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30242024-12-21T08:32:51.645ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30252024-12-21T08:32:51.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30262024-12-21T08:32:51.647ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30272024-12-21T08:32:51.647ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30282024-12-21T08:32:51.647ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.912093ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30292024-12-21T08:32:51.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30302024-12-21T08:32:51.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3b53ba2d-4d00-44a6-bd37-8306adc194ea, lookup_type: ById(3b53ba2d-4d00-44a6-bd37-8306adc194ea) } result = Ok(())
30312024-12-21T08:32:51.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30322024-12-21T08:32:51.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30332024-12-21T08:32:51.655ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 122.334689ms iteration = 30 status = 0
30342024-12-21T08:32:51.682ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
30352024-12-21T08:32:51.682ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30362024-12-21T08:32:51.683ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2df3b94-e0c9-4d6f-a55a-5de08158f99b", "content-length": "26", "date": "Sat, 21 Dec 2024 08:32:51 GMT"} })
30372024-12-21T08:32:51.683ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30382024-12-21T08:32:51.685ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 zone_address = fd00:1122:3344:101::2
30392024-12-21T08:32:51.685ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30402024-12-21T08:32:51.685ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "34e7b68f-fdb0-4aac-90fa-430f086f50b7", "content-length": "26", "date": "Sat, 21 Dec 2024 08:32:51 GMT"} })
30412024-12-21T08:32:51.685ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30422024-12-21T08:32:51.685ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30432024-12-21T08:32:51.686ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 153.327062ms iteration = 34 status = {"physical_disks_added":0}
30442024-12-21T08:32:51.687ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
30452024-12-21T08:32:51.726ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30462024-12-21T08:32:51.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30472024-12-21T08:32:51.743ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30482024-12-21T08:32:51.744ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "48f1b963-5eb7-4653-96ff-9bc1ceb25996", "content-length": "2", "date": "Sat, 21 Dec 2024 08:32:51 GMT"} })
30492024-12-21T08:32:51.745ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30502024-12-21T08:32:51.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30512024-12-21T08:32:51.838ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30522024-12-21T08:32:51.838ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30532024-12-21T08:32:51.839ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dec33885-a80a-4306-92cd-1ea172e6a813", "content-length": "372", "date": "Sat, 21 Dec 2024 08:32:51 GMT"} })
30542024-12-21T08:32:51.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30552024-12-21T08:32:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30562024-12-21T08:32:51.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30572024-12-21T08:32:51.841ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 308.512952ms iteration = 30 status = null
30582024-12-21T08:32:51.842ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30592024-12-21T08:32:51.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30602024-12-21T08:32:51.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30612024-12-21T08:32:51.849ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 316.517592ms iteration = 30 status = {}
30622024-12-21T08:32:51.871ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30632024-12-21T08:32:51.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30642024-12-21T08:32:51.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30652024-12-21T08:32:51.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30662024-12-21T08:32:51.879ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
30672024-12-21T08:32:51.879ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
30682024-12-21T08:32:51.880ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5cfe1681-d112-48c3-bf12-0730a7903754", "date": "Sat, 21 Dec 2024 08:32:51 GMT"} })
30692024-12-21T08:32:51.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30702024-12-21T08:32:51.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30712024-12-21T08:32:51.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30722024-12-21T08:32:51.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30732024-12-21T08:32:51.885ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30742024-12-21T08:32:51.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30752024-12-21T08:32:51.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30762024-12-21T08:32:51.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30772024-12-21T08:32:51.888ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30782024-12-21T08:32:51.888ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30792024-12-21T08:32:51.889ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4986737f-c249-4380-901f-c7ce67751b89, rack_id: dcff325a-cbfd-4a8c-805a-d5b8a1a42707, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a98489e0-d62f-4837-a1f0-df124db3049c) } rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0
30802024-12-21T08:32:51.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30812024-12-21T08:32:51.889ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6faefaf7-b8f0-4d66-b96f-649bc7bd15e1", "date": "Sat, 21 Dec 2024 08:32:51 GMT"} })
30822024-12-21T08:32:51.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30832024-12-21T08:32:51.890ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 358.310191ms iteration = 32 status = {}
30842024-12-21T08:32:51.908ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
30852024-12-21T08:32:51.909ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4e2e49c-fab0-4581-bfe9-f26e0829b254", "content-length": "134", "date": "Sat, 21 Dec 2024 08:32:51 GMT"} })
30862024-12-21T08:32:51.909ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
30872024-12-21T08:32:51.909ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a98489e0-d62f-4837-a1f0-df124db3049c
30882024-12-21T08:32:51.909ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
30892024-12-21T08:32:51.909ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30902024-12-21T08:32:51.909ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30912024-12-21T08:32:51.909ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30922024-12-21T08:32:51.909ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30932024-12-21T08:32:51.909ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30942024-12-21T08:32:51.910ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30952024-12-21T08:32:51.910ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30962024-12-21T08:32:51.910ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
30972024-12-21T08:32:51.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30982024-12-21T08:32:51.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30992024-12-21T08:32:51.912ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
31002024-12-21T08:32:51.912ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "33193994-4895-4288-9ea5-84fbf699f187", "content-length": "2", "date": "Sat, 21 Dec 2024 08:32:51 GMT"} })
31012024-12-21T08:32:51.912ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
31022024-12-21T08:32:51.912ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fb44adb-90ea-4d79-86d8-d40e56e6603a", "content-length": "52", "date": "Sat, 21 Dec 2024 08:32:51 GMT"} })
31032024-12-21T08:32:51.913ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0
31042024-12-21T08:32:51.913ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
31052024-12-21T08:32:51.980ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31062024-12-21T08:32:52.045ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6b1a9e82-8c51-48ea-895b-f8a1885e5f9b", "date": "Sat, 21 Dec 2024 08:32:51 GMT"} })
31072024-12-21T08:32:52.045ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch = Switch0
31082024-12-21T08:32:52.045ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31092024-12-21T08:32:52.045ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a45ca59-fb11-4d78-a2fe-6397be7104cb", "content-length": "682", "date": "Sat, 21 Dec 2024 08:32:51 GMT"} })
31102024-12-21T08:32:52.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31112024-12-21T08:32:52.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31122024-12-21T08:32:52.046ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "19f45478-e38d-49fe-b164-848a6a0bfa47", "content-length": "691", "date": "Sat, 21 Dec 2024 08:32:52 GMT"} })
31132024-12-21T08:32:52.046ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
31142024-12-21T08:32:52.046ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
31152024-12-21T08:32:52.046ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
31162024-12-21T08:32:52.048ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 515.684809ms iteration = 31 status = {}
31172024-12-21T08:32:52.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31182024-12-21T08:32:52.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31192024-12-21T08:32:52.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31202024-12-21T08:32:52.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31212024-12-21T08:32:52.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31222024-12-21T08:32:52.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31232024-12-21T08:32:52.070ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 537.233629ms iteration = 30 status = {}
31242024-12-21T08:32:52.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4898bb50-8b06-4499-81df-8b32e0b96372 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31252024-12-21T08:32:52.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4898bb50-8b06-4499-81df-8b32e0b96372 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31262024-12-21T08:32:52.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4898bb50-8b06-4499-81df-8b32e0b96372 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31272024-12-21T08:32:53.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9ce0d85e-6b5f-49c7-9283-4d68c5dac002 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31282024-12-21T08:32:53.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9ce0d85e-6b5f-49c7-9283-4d68c5dac002 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31292024-12-21T08:32:53.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2697 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9ce0d85e-6b5f-49c7-9283-4d68c5dac002 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31302024-12-21T08:32:54.533ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1494 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = ec611bf8-6f0b-4daf-98c7-363db65b4242 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
31312024-12-21T08:32:54.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 216458bb-15a8-49cd-8175-ae2db892394e roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31322024-12-21T08:32:54.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 216458bb-15a8-49cd-8175-ae2db892394e resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31332024-12-21T08:32:54.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 216458bb-15a8-49cd-8175-ae2db892394e response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31342024-12-21T08:32:55.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 118fdd38-9ef1-4417-9045-3ad663fb2d97 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31352024-12-21T08:32:55.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 118fdd38-9ef1-4417-9045-3ad663fb2d97 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31362024-12-21T08:32:55.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 118fdd38-9ef1-4417-9045-3ad663fb2d97 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31372024-12-21T08:32:56.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 70592b9a-9db3-4bb6-9afe-0b99642f0aa7 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31382024-12-21T08:32:56.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 70592b9a-9db3-4bb6-9afe-0b99642f0aa7 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31392024-12-21T08:32:56.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 70592b9a-9db3-4bb6-9afe-0b99642f0aa7 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31402024-12-21T08:32:57.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 39d63b13-3fb7-4679-9983-1c88e4af9141 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31412024-12-21T08:32:57.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 39d63b13-3fb7-4679-9983-1c88e4af9141 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31422024-12-21T08:32:57.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2556 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 39d63b13-3fb7-4679-9983-1c88e4af9141 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31432024-12-21T08:32:58.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 36ad637c-f63d-4579-9671-0e106be6e074 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31442024-12-21T08:32:58.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 36ad637c-f63d-4579-9671-0e106be6e074 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31452024-12-21T08:32:58.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2938 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 36ad637c-f63d-4579-9671-0e106be6e074 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31462024-12-21T08:32:59.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 8b513902-2c42-4151-b4c7-ef49e5c218cf roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31472024-12-21T08:32:59.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 8b513902-2c42-4151-b4c7-ef49e5c218cf resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31482024-12-21T08:32:59.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 8b513902-2c42-4151-b4c7-ef49e5c218cf response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31492024-12-21T08:33:00.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9acdea4e-1fe1-45c7-9bc4-a3c6aec83f66 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31502024-12-21T08:33:00.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9acdea4e-1fe1-45c7-9bc4-a3c6aec83f66 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31512024-12-21T08:33:00.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9acdea4e-1fe1-45c7-9bc4-a3c6aec83f66 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31522024-12-21T08:33:01.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
31532024-12-21T08:33:01.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
31542024-12-21T08:33:01.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31552024-12-21T08:33:01.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31562024-12-21T08:33:01.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31572024-12-21T08:33:01.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31582024-12-21T08:33:01.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31592024-12-21T08:33:01.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31602024-12-21T08:33:01.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31612024-12-21T08:33:01.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31622024-12-21T08:33:01.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31632024-12-21T08:33:01.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31642024-12-21T08:33:01.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31652024-12-21T08:33:01.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31662024-12-21T08:33:01.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.208493ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31672024-12-21T08:33:01.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31682024-12-21T08:33:01.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
31692024-12-21T08:33:01.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31702024-12-21T08:33:01.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31712024-12-21T08:33:01.608ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
31722024-12-21T08:33:01.608ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.648397ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
31732024-12-21T08:33:01.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 93bf94a2-08d4-40db-8326-4a7af10c6a09 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31742024-12-21T08:33:01.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 93bf94a2-08d4-40db-8326-4a7af10c6a09 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31752024-12-21T08:33:01.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 93bf94a2-08d4-40db-8326-4a7af10c6a09 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31762024-12-21T08:33:02.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = eda519d4-993e-432c-98ec-1a6696616fc9 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31772024-12-21T08:33:02.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = eda519d4-993e-432c-98ec-1a6696616fc9 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31782024-12-21T08:33:02.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = eda519d4-993e-432c-98ec-1a6696616fc9 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31792024-12-21T08:33:03.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2de9a3fe-f26c-4f23-a64c-1a36c070cc01 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31802024-12-21T08:33:03.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2de9a3fe-f26c-4f23-a64c-1a36c070cc01 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31812024-12-21T08:33:03.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2802 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2de9a3fe-f26c-4f23-a64c-1a36c070cc01 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31822024-12-21T08:33:04.533ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1485 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = ff6cd981-65ab-4542-8950-f365a6bb1c31 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
31832024-12-21T08:33:04.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7337b32e-0b4a-4554-bd8c-eb5d0945234d roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31842024-12-21T08:33:04.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7337b32e-0b4a-4554-bd8c-eb5d0945234d resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31852024-12-21T08:33:04.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1813 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7337b32e-0b4a-4554-bd8c-eb5d0945234d response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31862024-12-21T08:33:05.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3f6777fa-d592-497a-b238-85900a19e64a roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31872024-12-21T08:33:05.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3f6777fa-d592-497a-b238-85900a19e64a resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31882024-12-21T08:33:05.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3f6777fa-d592-497a-b238-85900a19e64a response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31892024-12-21T08:33:06.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = d837e603-c866-4c59-b6ac-03ea473b3a4b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
31902024-12-21T08:33:06.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = d837e603-c866-4c59-b6ac-03ea473b3a4b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
31912024-12-21T08:33:06.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = d837e603-c866-4c59-b6ac-03ea473b3a4b response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
31922024-12-21T08:33:06.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 64275583-f60b-44d9-9bdd-1db168ceb4f8 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31932024-12-21T08:33:06.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 64275583-f60b-44d9-9bdd-1db168ceb4f8 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31942024-12-21T08:33:06.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 64275583-f60b-44d9-9bdd-1db168ceb4f8 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31952024-12-21T08:33:07.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2721800c-ffd7-4410-9c00-06fa64c6541d roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31962024-12-21T08:33:07.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2721800c-ffd7-4410-9c00-06fa64c6541d resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31972024-12-21T08:33:07.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2721800c-ffd7-4410-9c00-06fa64c6541d response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31982024-12-21T08:33:08.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ef529c17-848d-41c4-9694-6313484d1a7a roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
31992024-12-21T08:33:08.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ef529c17-848d-41c4-9694-6313484d1a7a resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32002024-12-21T08:33:09.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ef529c17-848d-41c4-9694-6313484d1a7a response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32012024-12-21T08:33:10.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c0965beb-dc27-45c2-a724-866ee7a9d3a1 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32022024-12-21T08:33:10.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c0965beb-dc27-45c2-a724-866ee7a9d3a1 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32032024-12-21T08:33:10.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c0965beb-dc27-45c2-a724-866ee7a9d3a1 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32042024-12-21T08:33:11.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = df803fb3-7981-41de-bd30-d618b1ebbb97 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32052024-12-21T08:33:11.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = df803fb3-7981-41de-bd30-d618b1ebbb97 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32062024-12-21T08:33:11.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = df803fb3-7981-41de-bd30-d618b1ebbb97 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32072024-12-21T08:33:11.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
32082024-12-21T08:33:11.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
32092024-12-21T08:33:11.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32102024-12-21T08:33:11.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32112024-12-21T08:33:11.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32122024-12-21T08:33:11.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32132024-12-21T08:33:11.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32142024-12-21T08:33:11.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32152024-12-21T08:33:11.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32162024-12-21T08:33:11.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32172024-12-21T08:33:11.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32182024-12-21T08:33:11.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32192024-12-21T08:33:11.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32202024-12-21T08:33:11.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32212024-12-21T08:33:11.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32222024-12-21T08:33:11.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
32232024-12-21T08:33:11.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32242024-12-21T08:33:11.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32252024-12-21T08:33:11.582ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
32262024-12-21T08:33:11.582ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.027373ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
32272024-12-21T08:33:11.591ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.334884ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32282024-12-21T08:33:12.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 1428b10e-3cc9-4569-b1f2-dfc0afa34f51 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32292024-12-21T08:33:12.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 1428b10e-3cc9-4569-b1f2-dfc0afa34f51 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32302024-12-21T08:33:12.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 1428b10e-3cc9-4569-b1f2-dfc0afa34f51 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32312024-12-21T08:33:13.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9d429f91-d9d6-4090-bf0f-c8e1e6906bea roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32322024-12-21T08:33:13.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9d429f91-d9d6-4090-bf0f-c8e1e6906bea resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32332024-12-21T08:33:13.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9d429f91-d9d6-4090-bf0f-c8e1e6906bea response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32342024-12-21T08:33:14.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7e6a2c45-3efa-4097-8336-4fc85de567c7 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32352024-12-21T08:33:14.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7e6a2c45-3efa-4097-8336-4fc85de567c7 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32362024-12-21T08:33:14.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7e6a2c45-3efa-4097-8336-4fc85de567c7 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32372024-12-21T08:33:14.533ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1530 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = 4ef42970-9fa3-4e07-a60f-539f64aa81b5 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
32382024-12-21T08:33:15.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9c8155e8-dde4-4d6a-b039-207441899862 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32392024-12-21T08:33:15.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9c8155e8-dde4-4d6a-b039-207441899862 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32402024-12-21T08:33:15.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9c8155e8-dde4-4d6a-b039-207441899862 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32412024-12-21T08:33:16.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b0156076-7c07-43a6-aada-9e3dbad131f1 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32422024-12-21T08:33:16.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b0156076-7c07-43a6-aada-9e3dbad131f1 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32432024-12-21T08:33:16.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2659 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b0156076-7c07-43a6-aada-9e3dbad131f1 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32442024-12-21T08:33:17.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dc228972-a233-4ed2-b7bf-15e6de5b02d0 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32452024-12-21T08:33:17.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dc228972-a233-4ed2-b7bf-15e6de5b02d0 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32462024-12-21T08:33:17.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dc228972-a233-4ed2-b7bf-15e6de5b02d0 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32472024-12-21T08:33:18.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f36e48f0-9987-4abc-99b4-0a03222162e0 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32482024-12-21T08:33:18.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f36e48f0-9987-4abc-99b4-0a03222162e0 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32492024-12-21T08:33:18.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f36e48f0-9987-4abc-99b4-0a03222162e0 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32502024-12-21T08:33:19.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d2c69292-332a-4d3e-b2fc-905e3d539b92 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32512024-12-21T08:33:19.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d2c69292-332a-4d3e-b2fc-905e3d539b92 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32522024-12-21T08:33:19.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d2c69292-332a-4d3e-b2fc-905e3d539b92 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32532024-12-21T08:33:20.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = fe7e3283-d43e-4a2e-8e42-10c1863f7623 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32542024-12-21T08:33:20.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = fe7e3283-d43e-4a2e-8e42-10c1863f7623 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32552024-12-21T08:33:20.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = fe7e3283-d43e-4a2e-8e42-10c1863f7623 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32562024-12-21T08:33:21.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b9f1060b-f7ef-486f-a979-0264bb287fa2 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32572024-12-21T08:33:21.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b9f1060b-f7ef-486f-a979-0264bb287fa2 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32582024-12-21T08:33:21.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b9f1060b-f7ef-486f-a979-0264bb287fa2 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
32592024-12-21T08:33:21.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 17 reason = Timeout
32602024-12-21T08:33:21.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
32612024-12-21T08:33:21.532ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
32622024-12-21T08:33:21.532ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32632024-12-21T08:33:21.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32642024-12-21T08:33:21.532ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
32652024-12-21T08:33:21.532ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
32662024-12-21T08:33:21.532ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
32672024-12-21T08:33:21.532ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32682024-12-21T08:33:21.532ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32692024-12-21T08:33:21.532ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
32702024-12-21T08:33:21.532ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
32712024-12-21T08:33:21.532ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
32722024-12-21T08:33:21.532ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
32732024-12-21T08:33:21.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
32742024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
32752024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32762024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
32772024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
32782024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32792024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 17 reason = Timeout
32802024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 17 reason = Timeout
32812024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32822024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
32832024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32842024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 33 reason = Timeout
32852024-12-21T08:33:21.533ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32862024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
32872024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32882024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
32892024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32902024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 35 reason = Timeout
32912024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32922024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
32932024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32942024-12-21T08:33:21.533ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302
32952024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.7\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302"}
32962024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
32972024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 32 reason = Timeout
32982024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
32992024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33002024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33012024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33022024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33032024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
33042024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 17 reason = Timeout
33052024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
33062024-12-21T08:33:21.533ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
33072024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
33082024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
33092024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33102024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33112024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33122024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
33132024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
33142024-12-21T08:33:21.533ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 08:23:21.533183820 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
33152024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
33162024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 17 reason = Timeout
33172024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
33182024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
33192024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
33202024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
33212024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
33222024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33232024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
33242024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33252024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33262024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33272024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
33282024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33292024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33302024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
33312024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33322024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33332024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33342024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33352024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33362024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33372024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33382024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33392024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33402024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33412024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33422024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33432024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33442024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33452024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33462024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
33472024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33482024-12-21T08:33:21.533ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("35bcbd45-3578-45df-b73d-00c21093df02.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50a4d151-f70f-4790-a525-028d2812625b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bdf4fa9e-0938-4aac-903e-8935b21f0685.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bdf4fa9e-0938-4aac-903e-8935b21f0685.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1883, tv_nsec: 520262143 } })
33492024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33502024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33512024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33522024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
33532024-12-21T08:33:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33542024-12-21T08:33:21.533ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5037fa1b-4769-431c-8e17-0ed172e6d4e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea826706-9f75-4635-8793-1730a859a368.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea826706-9f75-4635-8793-1730a859a368.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1883, tv_nsec: 520326883 } })
33552024-12-21T08:33:21.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33562024-12-21T08:33:21.534ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33572024-12-21T08:33:21.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33582024-12-21T08:33:21.534ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33592024-12-21T08:33:21.534ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
33602024-12-21T08:33:21.534ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.21833ms iteration = 17 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
33612024-12-21T08:33:21.534ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
33622024-12-21T08:33:21.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33632024-12-21T08:33:21.534ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.22432ms iteration = 17 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
33642024-12-21T08:33:21.534ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33652024-12-21T08:33:21.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33662024-12-21T08:33:21.536ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.270909ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
33672024-12-21T08:33:21.536ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.658432ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33682024-12-21T08:33:21.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33692024-12-21T08:33:21.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33702024-12-21T08:33:21.537ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33712024-12-21T08:33:21.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33722024-12-21T08:33:21.537ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33732024-12-21T08:33:21.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33742024-12-21T08:33:21.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33752024-12-21T08:33:21.539ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33762024-12-21T08:33:21.539ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1883, tv_nsec: 526391427 } })
33772024-12-21T08:33:21.540ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33782024-12-21T08:33:21.540ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
33792024-12-21T08:33:21.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33802024-12-21T08:33:21.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33812024-12-21T08:33:21.541ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33822024-12-21T08:33:21.541ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33832024-12-21T08:33:21.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33842024-12-21T08:33:21.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33852024-12-21T08:33:21.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33862024-12-21T08:33:21.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33872024-12-21T08:33:21.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33882024-12-21T08:33:21.548ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33892024-12-21T08:33:21.550ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33902024-12-21T08:33:21.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
33912024-12-21T08:33:21.550ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33922024-12-21T08:33:21.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33932024-12-21T08:33:21.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
33942024-12-21T08:33:21.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33952024-12-21T08:33:21.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33962024-12-21T08:33:21.552ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1883, tv_nsec: 539210110 } })
33972024-12-21T08:33:21.553ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
33982024-12-21T08:33:21.554ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33992024-12-21T08:33:21.554ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 08:23:21.533183820 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
34002024-12-21T08:33:21.554ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 21.349918ms iteration = 16 status = {"expiration":"2024-12-21T08:23:21.533183820Z","pruned":[]}
34012024-12-21T08:33:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34022024-12-21T08:33:21.555ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34032024-12-21T08:33:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34042024-12-21T08:33:21.557ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34052024-12-21T08:33:21.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34062024-12-21T08:33:21.559ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34072024-12-21T08:33:21.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34082024-12-21T08:33:21.564ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34092024-12-21T08:33:21.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34102024-12-21T08:33:21.569ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34112024-12-21T08:33:21.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34122024-12-21T08:33:21.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34132024-12-21T08:33:21.583ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34142024-12-21T08:33:21.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34152024-12-21T08:33:21.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34162024-12-21T08:33:21.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34172024-12-21T08:33:21.585ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
34182024-12-21T08:33:21.585ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
34192024-12-21T08:33:21.585ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 52.792706ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
34202024-12-21T08:33:21.586ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34212024-12-21T08:33:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34222024-12-21T08:33:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34232024-12-21T08:33:21.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34242024-12-21T08:33:21.586ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34252024-12-21T08:33:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34262024-12-21T08:33:21.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.991237ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
34272024-12-21T08:33:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34282024-12-21T08:33:21.587ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34292024-12-21T08:33:21.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34302024-12-21T08:33:21.588ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34312024-12-21T08:33:21.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34322024-12-21T08:33:21.589ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1883, tv_nsec: 576339608 } })
34332024-12-21T08:33:21.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34342024-12-21T08:33:21.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.105594ms iteration = 31 status = {"errors":[],"finish_invoked_ok":[]}
34352024-12-21T08:33:21.590ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
34362024-12-21T08:33:21.590ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34372024-12-21T08:33:21.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34382024-12-21T08:33:21.591ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34392024-12-21T08:33:21.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34402024-12-21T08:33:21.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34412024-12-21T08:33:21.593ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34422024-12-21T08:33:21.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34432024-12-21T08:33:21.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34442024-12-21T08:33:21.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
34452024-12-21T08:33:21.595ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34462024-12-21T08:33:21.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34472024-12-21T08:33:21.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34482024-12-21T08:33:21.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34492024-12-21T08:33:21.596ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34502024-12-21T08:33:21.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34512024-12-21T08:33:21.596ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34522024-12-21T08:33:21.596ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34532024-12-21T08:33:21.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34542024-12-21T08:33:21.597ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34552024-12-21T08:33:21.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34562024-12-21T08:33:21.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34572024-12-21T08:33:21.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34582024-12-21T08:33:21.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34592024-12-21T08:33:21.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34602024-12-21T08:33:21.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34612024-12-21T08:33:21.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34622024-12-21T08:33:21.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34632024-12-21T08:33:21.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34642024-12-21T08:33:21.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34652024-12-21T08:33:21.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34662024-12-21T08:33:21.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34672024-12-21T08:33:21.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34682024-12-21T08:33:21.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34692024-12-21T08:33:21.606ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34702024-12-21T08:33:21.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34712024-12-21T08:33:21.606ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34722024-12-21T08:33:21.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34732024-12-21T08:33:21.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34742024-12-21T08:33:21.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34752024-12-21T08:33:21.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34762024-12-21T08:33:21.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34772024-12-21T08:33:21.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
34782024-12-21T08:33:21.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34792024-12-21T08:33:21.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34802024-12-21T08:33:21.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34812024-12-21T08:33:21.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34822024-12-21T08:33:21.614ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34832024-12-21T08:33:21.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34842024-12-21T08:33:21.617ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 83.92658ms iteration = 7 status = {"nsuccess":5}
34852024-12-21T08:33:21.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34862024-12-21T08:33:21.620ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
34872024-12-21T08:33:21.620ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
34882024-12-21T08:33:21.620ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
34892024-12-21T08:33:21.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34902024-12-21T08:33:21.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34912024-12-21T08:33:21.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34922024-12-21T08:33:21.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34932024-12-21T08:33:21.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34942024-12-21T08:33:21.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34952024-12-21T08:33:21.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34962024-12-21T08:33:21.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34972024-12-21T08:33:21.627ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
34982024-12-21T08:33:21.627ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
34992024-12-21T08:33:21.627ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 94.039459ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
35002024-12-21T08:33:21.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35012024-12-21T08:33:21.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35022024-12-21T08:33:21.628ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
35032024-12-21T08:33:21.628ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 95.727414ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
35042024-12-21T08:33:21.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35052024-12-21T08:33:21.630ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35062024-12-21T08:33:21.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35072024-12-21T08:33:21.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.891023ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35082024-12-21T08:33:21.632ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35092024-12-21T08:33:21.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35102024-12-21T08:33:21.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3b53ba2d-4d00-44a6-bd37-8306adc194ea, lookup_type: ById(3b53ba2d-4d00-44a6-bd37-8306adc194ea) } result = Ok(())
35112024-12-21T08:33:21.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35122024-12-21T08:33:21.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35132024-12-21T08:33:21.633ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35142024-12-21T08:33:21.633ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 100.495007ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35152024-12-21T08:33:21.635ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35162024-12-21T08:33:21.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35172024-12-21T08:33:21.635ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35182024-12-21T08:33:21.636ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 102.990169ms iteration = 31 status = 0
35192024-12-21T08:33:21.636ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35202024-12-21T08:33:21.636ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35212024-12-21T08:33:21.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35222024-12-21T08:33:21.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 109.884809ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35232024-12-21T08:33:21.653ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35242024-12-21T08:33:21.653ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35252024-12-21T08:33:21.653ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35262024-12-21T08:33:21.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35272024-12-21T08:33:21.656ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35282024-12-21T08:33:21.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35292024-12-21T08:33:21.657ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
35302024-12-21T08:33:21.657ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35312024-12-21T08:33:21.657ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
35322024-12-21T08:33:21.658ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "525ffd40-0583-4b40-ad90-3551450f415b", "content-length": "26", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} })
35332024-12-21T08:33:21.658ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35342024-12-21T08:33:21.658ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 125.046403ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35352024-12-21T08:33:21.658ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35362024-12-21T08:33:21.659ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
35372024-12-21T08:33:21.659ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
35382024-12-21T08:33:21.659ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
35392024-12-21T08:33:21.659ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35402024-12-21T08:33:21.659ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35412024-12-21T08:33:21.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35422024-12-21T08:33:21.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
35432024-12-21T08:33:21.662ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35442024-12-21T08:33:21.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35452024-12-21T08:33:21.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35462024-12-21T08:33:21.663ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35472024-12-21T08:33:21.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35482024-12-21T08:33:21.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35492024-12-21T08:33:21.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35502024-12-21T08:33:21.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35512024-12-21T08:33:21.668ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
35522024-12-21T08:33:21.668ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e0ed7f2-a28d-41ab-87a3-81b7138901c7 dns_zone_name = oxide.test found_so_far = 0 version = 2
35532024-12-21T08:33:21.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35542024-12-21T08:33:21.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35552024-12-21T08:33:21.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 136.407854ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
35562024-12-21T08:33:21.673ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
35572024-12-21T08:33:21.673ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 825f8681-b5f6-43ad-8053-b0be9965d93d dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
35582024-12-21T08:33:21.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35592024-12-21T08:33:21.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35602024-12-21T08:33:21.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35612024-12-21T08:33:21.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35622024-12-21T08:33:21.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35632024-12-21T08:33:21.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35642024-12-21T08:33:21.679ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
35652024-12-21T08:33:21.682ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 825f8681-b5f6-43ad-8053-b0be9965d93d dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
35662024-12-21T08:33:21.682ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
35672024-12-21T08:33:21.682ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 08:18:22.068410 UTC dns_group = internal generation = 1
35682024-12-21T08:33:21.682ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 149.124755ms iteration = 17 status = {"generation":1}
35692024-12-21T08:33:21.690ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35702024-12-21T08:33:21.690ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35712024-12-21T08:33:21.690ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 157.574939ms iteration = 32 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35722024-12-21T08:33:21.698ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35732024-12-21T08:33:21.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35742024-12-21T08:33:21.701ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T08:18:19.279666Z, time_modified: 2024-12-21T08:18:19.279666Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 36ce767e-8d13-48fc-b54f-25a543752b28, db_silo: Silo { identity: SiloIdentity { id: 36ce767e-8d13-48fc-b54f-25a543752b28, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T08:18:23.511483Z, time_modified: 2024-12-21T08:18:23.511483Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d4d3d1815f342882ad1c1687b3d9b611837e26888f379a800d2fbe2710458245" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 36ce767e-8d13-48fc-b54f-25a543752b28, db_silo: Silo { identity: SiloIdentity { id: 36ce767e-8d13-48fc-b54f-25a543752b28, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T08:18:23.511483Z, time_modified: 2024-12-21T08:18:23.511483Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d4d3d1815f342882ad1c1687b3d9b611837e26888f379a800d2fbe2710458245" }] }) }
35752024-12-21T08:33:21.701ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 168.830909ms iteration = 17 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"36ce767e-8d13-48fc-b54f-25a543752b28","tls_certs":["d4d3d1815f342882ad1c1687b3d9b611837e26888f379a800d2fbe2710458245"]}},"default_endpoint":{"silo_id":"36ce767e-8d13-48fc-b54f-25a543752b28","tls_certs":["d4d3d1815f342882ad1c1687b3d9b611837e26888f379a800d2fbe2710458245"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
35762024-12-21T08:33:21.704ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35772024-12-21T08:33:21.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35782024-12-21T08:33:21.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35792024-12-21T08:33:21.708ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
35802024-12-21T08:33:21.708ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 175.633639ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
35812024-12-21T08:33:21.710ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35822024-12-21T08:33:21.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35832024-12-21T08:33:21.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35842024-12-21T08:33:21.711ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
35852024-12-21T08:33:21.711ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35862024-12-21T08:33:21.711ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6c3350f-37c8-4f69-9d3c-76102b02e42e", "content-length": "26", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} })
35872024-12-21T08:33:21.711ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35882024-12-21T08:33:21.713ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35892024-12-21T08:33:21.731ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 198.536641ms iteration = 35 status = {"physical_disks_added":0}
35902024-12-21T08:33:21.768ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 zone_address = fd00:1122:3344:101::2
35912024-12-21T08:33:21.768ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35922024-12-21T08:33:21.768ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fdd6086-5284-4eb3-8d5f-429a3783e9e2", "content-length": "26", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} })
35932024-12-21T08:33:21.768ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35942024-12-21T08:33:21.770ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
35952024-12-21T08:33:21.809ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
35962024-12-21T08:33:21.814ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35972024-12-21T08:33:21.814ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "206ca12a-dba7-4f68-a131-207ee7468769", "content-length": "2", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} })
35982024-12-21T08:33:21.816ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35992024-12-21T08:33:21.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36002024-12-21T08:33:21.844ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
36012024-12-21T08:33:21.844ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "65c98d89-8b5c-4619-a6ae-98b23e27d8b6", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36022024-12-21T08:33:21.844ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36032024-12-21T08:33:21.844ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36042024-12-21T08:33:21.844ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36052024-12-21T08:33:21.845ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "91442133-8685-49c2-a7ef-412f3bda2ae4", "content-length": "372", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} })
36062024-12-21T08:33:21.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36072024-12-21T08:33:21.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36082024-12-21T08:33:21.846ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36092024-12-21T08:33:21.847ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4758ccd8-0d7b-4b23-aa4b-40124b4c89d2", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36102024-12-21T08:33:21.847ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36112024-12-21T08:33:21.847ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e0ed7f2-a28d-41ab-87a3-81b7138901c7 dns_zone_name = oxide.test found_so_far = 1 version = 2
36122024-12-21T08:33:21.847ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
36132024-12-21T08:33:21.847ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 08:18:23.563952 UTC dns_group = external generation = 2
36142024-12-21T08:33:21.847ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 314.714985ms iteration = 31 status = null
36152024-12-21T08:33:21.847ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 314.835637ms iteration = 17 status = {"generation":2}
36162024-12-21T08:33:21.849ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36172024-12-21T08:33:21.849ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 316.139308ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
36182024-12-21T08:33:21.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
36192024-12-21T08:33:21.850ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36202024-12-21T08:33:21.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36212024-12-21T08:33:21.853ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36222024-12-21T08:33:21.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36232024-12-21T08:33:21.854ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36242024-12-21T08:33:21.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36252024-12-21T08:33:21.856ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36262024-12-21T08:33:21.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36272024-12-21T08:33:21.858ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36282024-12-21T08:33:21.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36292024-12-21T08:33:21.860ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36302024-12-21T08:33:21.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36312024-12-21T08:33:21.861ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36322024-12-21T08:33:21.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36332024-12-21T08:33:21.863ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
36342024-12-21T08:33:21.863ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36352024-12-21T08:33:21.863ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36362024-12-21T08:33:21.863ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "93f59860-64ae-4fc8-bccb-403674accd27", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} })
36372024-12-21T08:33:21.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36382024-12-21T08:33:21.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36392024-12-21T08:33:21.865ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 332.375481ms iteration = 31 status = {}
36402024-12-21T08:33:21.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36412024-12-21T08:33:21.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36422024-12-21T08:33:21.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
36432024-12-21T08:33:21.867ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36442024-12-21T08:33:21.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36452024-12-21T08:33:21.869ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36462024-12-21T08:33:21.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36472024-12-21T08:33:21.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36482024-12-21T08:33:21.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36492024-12-21T08:33:21.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36502024-12-21T08:33:21.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36512024-12-21T08:33:21.871ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
36522024-12-21T08:33:21.871ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36532024-12-21T08:33:21.872ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c58363c7-2e4f-4d83-b8ac-09cda12cf710", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} })
36542024-12-21T08:33:21.873ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36552024-12-21T08:33:21.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36562024-12-21T08:33:21.874ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 341.479522ms iteration = 33 status = {}
36572024-12-21T08:33:21.875ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36582024-12-21T08:33:21.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36592024-12-21T08:33:21.876ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36602024-12-21T08:33:21.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36612024-12-21T08:33:21.878ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36622024-12-21T08:33:21.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36632024-12-21T08:33:21.879ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36642024-12-21T08:33:21.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36652024-12-21T08:33:21.883ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
36662024-12-21T08:33:21.883ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36672024-12-21T08:33:21.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36682024-12-21T08:33:21.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36692024-12-21T08:33:21.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36702024-12-21T08:33:21.885ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36712024-12-21T08:33:21.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36722024-12-21T08:33:21.886ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36732024-12-21T08:33:21.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36742024-12-21T08:33:21.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36752024-12-21T08:33:21.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36762024-12-21T08:33:21.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36772024-12-21T08:33:21.888ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36782024-12-21T08:33:21.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36792024-12-21T08:33:21.891ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36802024-12-21T08:33:21.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36812024-12-21T08:33:21.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36822024-12-21T08:33:21.894ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
36832024-12-21T08:33:21.894ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36842024-12-21T08:33:21.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36852024-12-21T08:33:21.899ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36862024-12-21T08:33:21.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36872024-12-21T08:33:21.899ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
36882024-12-21T08:33:21.900ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0dd30246-febc-498e-8c13-c40be27b2a1e", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36892024-12-21T08:33:21.900ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36902024-12-21T08:33:21.900ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36912024-12-21T08:33:21.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36922024-12-21T08:33:21.901ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6b6df8cc-14c1-47a6-973e-0d536fded0d8", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36932024-12-21T08:33:21.901ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36942024-12-21T08:33:21.902ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36952024-12-21T08:33:21.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36962024-12-21T08:33:21.904ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "837781f5-a343-47a7-bd93-620926c80cfe", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36972024-12-21T08:33:21.904ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36982024-12-21T08:33:21.905ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36992024-12-21T08:33:21.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37002024-12-21T08:33:21.906ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
37012024-12-21T08:33:21.906ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 373.031281ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
37022024-12-21T08:33:21.907ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37032024-12-21T08:33:21.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37042024-12-21T08:33:21.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37052024-12-21T08:33:21.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37062024-12-21T08:33:21.910ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37072024-12-21T08:33:21.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37082024-12-21T08:33:21.912ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37092024-12-21T08:33:21.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
37102024-12-21T08:33:21.917ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37112024-12-21T08:33:21.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37122024-12-21T08:33:21.918ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37132024-12-21T08:33:21.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37142024-12-21T08:33:21.923ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37152024-12-21T08:33:21.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37162024-12-21T08:33:21.925ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37172024-12-21T08:33:21.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
37182024-12-21T08:33:21.930ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37192024-12-21T08:33:21.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37202024-12-21T08:33:21.939ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 3c01cb05-9842-4b05-bf94-628b02ef3c91, kind: Service { id: 4a1e80ef-44d3-4759-a693-2db4746da02d }, name: Name("nexus-4a1e80ef-44d3-4759-a693-2db4746da02d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 228])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 72f70e31-4590-44ec-b392-b83a96d5d251, kind: Service { id: 80ab7034-d796-4108-a2ea-ee449a96585e }, name: Name("nexus-80ab7034-d796-4108-a2ea-ee449a96585e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8d4281ff-b0a4-4fec-88c3-9e5ae746411c, kind: Service { id: f7a8e0f2-9b47-4c2a-b65d-5e767d7bbcfb }, name: Name("nexus-f7a8e0f2-9b47-4c2a-b65d-5e767d7bbcfb"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 8a4e6796-f23c-443e-9207-986d5490b719, kind: Service { id: 5037fa1b-4769-431c-8e17-0ed172e6d4e7 }, name: Name("external-dns-5037fa1b-4769-431c-8e17-0ed172e6d4e7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 41])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef69a4c1-ed4e-43d2-905b-e9b394b80bf0, kind: Service { id: ea826706-9f75-4635-8793-1730a859a368 }, name: Name("external-dns-ea826706-9f75-4635-8793-1730a859a368"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 211])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
37212024-12-21T08:33:21.939ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37222024-12-21T08:33:21.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37232024-12-21T08:33:21.941ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37242024-12-21T08:33:21.944ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
37252024-12-21T08:33:21.944ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37262024-12-21T08:33:21.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37272024-12-21T08:33:21.946ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
37282024-12-21T08:33:21.946ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 8a4e6796-f23c-443e-9207-986d5490b719, kind: Service { id: 5037fa1b-4769-431c-8e17-0ed172e6d4e7 }, name: Name("external-dns-5037fa1b-4769-431c-8e17-0ed172e6d4e7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 41])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef69a4c1-ed4e-43d2-905b-e9b394b80bf0, kind: Service { id: ea826706-9f75-4635-8793-1730a859a368 }, name: Name("external-dns-ea826706-9f75-4635-8793-1730a859a368"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 211])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3c01cb05-9842-4b05-bf94-628b02ef3c91, kind: Service { id: 4a1e80ef-44d3-4759-a693-2db4746da02d }, name: Name("nexus-4a1e80ef-44d3-4759-a693-2db4746da02d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 228])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 72f70e31-4590-44ec-b392-b83a96d5d251, kind: Service { id: 80ab7034-d796-4108-a2ea-ee449a96585e }, name: Name("nexus-80ab7034-d796-4108-a2ea-ee449a96585e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8d4281ff-b0a4-4fec-88c3-9e5ae746411c, kind: Service { id: f7a8e0f2-9b47-4c2a-b65d-5e767d7bbcfb }, name: Name("nexus-f7a8e0f2-9b47-4c2a-b65d-5e767d7bbcfb"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
37292024-12-21T08:33:21.946ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
37302024-12-21T08:33:21.980ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37312024-12-21T08:33:21.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37322024-12-21T08:33:21.983ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4986737f-c249-4380-901f-c7ce67751b89, rack_id: dcff325a-cbfd-4a8c-805a-d5b8a1a42707, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a98489e0-d62f-4837-a1f0-df124db3049c) } rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0
37332024-12-21T08:33:21.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37342024-12-21T08:33:21.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37352024-12-21T08:33:21.992ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37362024-12-21T08:33:21.993ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c999a8db-bdc7-4d82-bc4c-550041975dcd", "content-length": "134", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} })
37372024-12-21T08:33:21.993ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37382024-12-21T08:33:21.993ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a98489e0-d62f-4837-a1f0-df124db3049c
37392024-12-21T08:33:21.993ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37402024-12-21T08:33:21.993ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37412024-12-21T08:33:21.993ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37422024-12-21T08:33:21.993ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37432024-12-21T08:33:21.993ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37442024-12-21T08:33:21.993ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37452024-12-21T08:33:21.993ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37462024-12-21T08:33:21.993ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37472024-12-21T08:33:21.994ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
37482024-12-21T08:33:21.994ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37492024-12-21T08:33:21.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37502024-12-21T08:33:21.995ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37512024-12-21T08:33:21.995ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "af24a1b3-a545-4b40-aebe-28fda6b24b9b", "content-length": "2", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} })
37522024-12-21T08:33:21.995ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37532024-12-21T08:33:21.995ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "18f3ef60-4eb6-4ae3-b0a7-d9671f6eb5ad", "content-length": "52", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} })
37542024-12-21T08:33:21.995ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0
37552024-12-21T08:33:21.995ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37562024-12-21T08:33:22.001ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37572024-12-21T08:33:22.003ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 3b53ba2d-4d00-44a6-bd37-8306adc194ea, time_created: 2024-12-21T08:18:21.457081Z, time_modified: 2024-12-21T08:18:21.457081Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: dcff325a-cbfd-4a8c-805a-d5b8a1a42707, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
37582024-12-21T08:33:22.003ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
37592024-12-21T08:33:22.003ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37602024-12-21T08:33:22.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37612024-12-21T08:33:22.005ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37622024-12-21T08:33:22.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37632024-12-21T08:33:22.007ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37642024-12-21T08:33:22.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 3b53ba2d-4d00-44a6-bd37-8306adc194ea, lookup_type: ById(3b53ba2d-4d00-44a6-bd37-8306adc194ea) } result = Ok(())
37652024-12-21T08:33:22.070ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
37662024-12-21T08:33:22.167ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3af86e17-bb56-4d64-a53c-9ca2153e3b01", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} })
37672024-12-21T08:33:22.167ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch = Switch0
37682024-12-21T08:33:22.167ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37692024-12-21T08:33:22.168ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b7a8adb-a46e-4db4-be3f-a27efe432c7b", "content-length": "691", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} })
37702024-12-21T08:33:22.168ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37712024-12-21T08:33:22.168ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37722024-12-21T08:33:22.168ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37732024-12-21T08:33:22.168ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "17fed06e-fa1d-4bb1-a7bf-11cd952a7398", "content-length": "682", "date": "Sat, 21 Dec 2024 08:33:21 GMT"} })
37742024-12-21T08:33:22.168ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37752024-12-21T08:33:22.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37762024-12-21T08:33:22.169ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "8d2b58db-dcc7-4c38-8340-4dfeed2e641c", "date": "Sat, 21 Dec 2024 08:33:22 GMT"} })
37772024-12-21T08:33:22.170ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 637.518303ms iteration = 32 status = {}
37782024-12-21T08:33:22.171ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
37792024-12-21T08:33:22.171ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 638.519042ms
37802024-12-21T08:33:22.171ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 638.534672ms iteration = 4 status = {}
37812024-12-21T08:33:22.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37822024-12-21T08:33:22.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37832024-12-21T08:33:22.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37842024-12-21T08:33:22.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37852024-12-21T08:33:22.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37862024-12-21T08:33:22.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37872024-12-21T08:33:22.199ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 666.134055ms iteration = 31 status = {}
37882024-12-21T08:33:22.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4b7c4018-4bfc-4985-98aa-a9cd871a4fb7 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
37892024-12-21T08:33:22.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4b7c4018-4bfc-4985-98aa-a9cd871a4fb7 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
37902024-12-21T08:33:22.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4b7c4018-4bfc-4985-98aa-a9cd871a4fb7 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
37912024-12-21T08:33:23.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6004ebb8-c11c-4b12-a363-41e86afcb6ab roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
37922024-12-21T08:33:23.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6004ebb8-c11c-4b12-a363-41e86afcb6ab resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
37932024-12-21T08:33:23.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6004ebb8-c11c-4b12-a363-41e86afcb6ab response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
37942024-12-21T08:33:24.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 76a5bc69-c992-42a2-877e-5db1d12f655a roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
37952024-12-21T08:33:24.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 76a5bc69-c992-42a2-877e-5db1d12f655a resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
37962024-12-21T08:33:24.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 76a5bc69-c992-42a2-877e-5db1d12f655a response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
37972024-12-21T08:33:24.534ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1526 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = eab1e070-68c1-4bb9-bac4-d07d1f8e997a response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
37982024-12-21T08:33:25.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7045218a-9373-454d-9e73-bff219c5a031 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
37992024-12-21T08:33:25.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7045218a-9373-454d-9e73-bff219c5a031 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38002024-12-21T08:33:25.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 7045218a-9373-454d-9e73-bff219c5a031 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38012024-12-21T08:33:25.471ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
38022024-12-21T08:33:25.471ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
38032024-12-21T08:33:25.502ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
38042024-12-21T08:33:25.502ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:56350
38052024-12-21T08:33:25.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56350 req_id = c0a3b8bc-42de-4665-9cac-9c71f51c1c08 roles = RoleSet { roles: {} } uri = /metrics/producers
38062024-12-21T08:33:25.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56350 req_id = c0a3b8bc-42de-4665-9cac-9c71f51c1c08 resource = Database result = Ok(()) uri = /metrics/producers
38072024-12-21T08:33:25.540ZINFOnexus: assigned collector to new producer collector_id = d3e17b73-750a-4d54-b6e9-cb13b0984ebb file = nexus/src/app/oximeter.rs:76 producer_id = 4a1e80ef-44d3-4759-a693-2db4746da02d
38082024-12-21T08:33:25.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37970 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56350 req_id = c0a3b8bc-42de-4665-9cac-9c71f51c1c08 response_code = 201 uri = /metrics/producers
38092024-12-21T08:33:25.540ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "c0a3b8bc-42de-4665-9cac-9c71f51c1c08", "content-length": "41", "date": "Sat, 21 Dec 2024 08:33:25 GMT"} })
38102024-12-21T08:33:25.543ZDEBGnexus (producer-registration-task): registered with nexus successfully
38112024-12-21T08:33:25.543ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
38122024-12-21T08:33:26.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c0a07647-334c-4d46-b6c8-0049b6ecd5b9 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38132024-12-21T08:33:26.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c0a07647-334c-4d46-b6c8-0049b6ecd5b9 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38142024-12-21T08:33:26.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c0a07647-334c-4d46-b6c8-0049b6ecd5b9 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38152024-12-21T08:33:27.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 01074c37-f5e8-4429-8a7b-d9065187b91b roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38162024-12-21T08:33:27.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 01074c37-f5e8-4429-8a7b-d9065187b91b resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38172024-12-21T08:33:27.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1777 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 01074c37-f5e8-4429-8a7b-d9065187b91b response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38182024-12-21T08:33:28.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2e187d4e-bd52-431c-b7aa-7fc5f4287ddc roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38192024-12-21T08:33:28.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2e187d4e-bd52-431c-b7aa-7fc5f4287ddc resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38202024-12-21T08:33:28.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2e187d4e-bd52-431c-b7aa-7fc5f4287ddc response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38212024-12-21T08:33:29.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c884f4f1-bbf4-4f96-b2d3-199b5f58c05b roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38222024-12-21T08:33:29.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c884f4f1-bbf4-4f96-b2d3-199b5f58c05b resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38232024-12-21T08:33:29.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c884f4f1-bbf4-4f96-b2d3-199b5f58c05b response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38242024-12-21T08:33:30.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c7bb0fa2-97e2-44c2-9e83-8aa5e6aac88c roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38252024-12-21T08:33:30.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c7bb0fa2-97e2-44c2-9e83-8aa5e6aac88c resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38262024-12-21T08:33:30.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = c7bb0fa2-97e2-44c2-9e83-8aa5e6aac88c response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38272024-12-21T08:33:31.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b55a8e57-0d81-4ad9-b26c-2bfca817e737 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38282024-12-21T08:33:31.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b55a8e57-0d81-4ad9-b26c-2bfca817e737 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38292024-12-21T08:33:31.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b55a8e57-0d81-4ad9-b26c-2bfca817e737 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38302024-12-21T08:33:31.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
38312024-12-21T08:33:31.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
38322024-12-21T08:33:31.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38332024-12-21T08:33:31.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38342024-12-21T08:33:31.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38352024-12-21T08:33:31.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38362024-12-21T08:33:31.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38372024-12-21T08:33:31.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38382024-12-21T08:33:31.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38392024-12-21T08:33:31.537ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.043466ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38402024-12-21T08:33:31.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38412024-12-21T08:33:31.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38422024-12-21T08:33:31.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38432024-12-21T08:33:31.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38442024-12-21T08:33:31.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38452024-12-21T08:33:31.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38462024-12-21T08:33:31.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
38472024-12-21T08:33:31.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38482024-12-21T08:33:31.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38492024-12-21T08:33:31.557ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
38502024-12-21T08:33:31.557ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.920421ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
38512024-12-21T08:33:32.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 93500352-cc1f-4ffd-8dd7-eb9bf10abb90 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38522024-12-21T08:33:32.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 93500352-cc1f-4ffd-8dd7-eb9bf10abb90 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38532024-12-21T08:33:32.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 93500352-cc1f-4ffd-8dd7-eb9bf10abb90 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38542024-12-21T08:33:33.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6f4a4ddf-fb81-4b65-9e58-115ff425ef1f roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38552024-12-21T08:33:33.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6f4a4ddf-fb81-4b65-9e58-115ff425ef1f resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38562024-12-21T08:33:33.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 6f4a4ddf-fb81-4b65-9e58-115ff425ef1f response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38572024-12-21T08:33:34.534ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1693 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = dc3f49e9-536a-4de9-a3d6-3bffbd685106 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
38582024-12-21T08:33:34.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2c2b9c85-d0fc-45b6-83fb-ee37d48bca0e roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38592024-12-21T08:33:34.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2c2b9c85-d0fc-45b6-83fb-ee37d48bca0e resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38602024-12-21T08:33:34.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1938 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2c2b9c85-d0fc-45b6-83fb-ee37d48bca0e response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38612024-12-21T08:33:35.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2118d9fe-1670-46c3-acd9-4d37d5d2711a roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38622024-12-21T08:33:35.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2118d9fe-1670-46c3-acd9-4d37d5d2711a resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38632024-12-21T08:33:35.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2844 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2118d9fe-1670-46c3-acd9-4d37d5d2711a response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38642024-12-21T08:33:36.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = 7a54a526-ec9a-45d0-b5fc-76f021a2a26d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
38652024-12-21T08:33:36.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = 7a54a526-ec9a-45d0-b5fc-76f021a2a26d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
38662024-12-21T08:33:36.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = 7a54a526-ec9a-45d0-b5fc-76f021a2a26d response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
38672024-12-21T08:33:36.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b199b444-dc23-4755-b582-5d0f0812f986 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38682024-12-21T08:33:36.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b199b444-dc23-4755-b582-5d0f0812f986 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38692024-12-21T08:33:36.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b199b444-dc23-4755-b582-5d0f0812f986 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38702024-12-21T08:33:37.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3ddbeb8b-88ae-46d7-b2e9-54c0a35102d6 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38712024-12-21T08:33:37.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3ddbeb8b-88ae-46d7-b2e9-54c0a35102d6 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38722024-12-21T08:33:37.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3ddbeb8b-88ae-46d7-b2e9-54c0a35102d6 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38732024-12-21T08:33:38.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = af798131-d1e4-492b-a60a-2e1e4ca8e6b2 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38742024-12-21T08:33:38.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = af798131-d1e4-492b-a60a-2e1e4ca8e6b2 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38752024-12-21T08:33:38.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = af798131-d1e4-492b-a60a-2e1e4ca8e6b2 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38762024-12-21T08:33:39.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 84c40754-5354-4d7d-8e88-07bbc0d87b15 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38772024-12-21T08:33:39.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 84c40754-5354-4d7d-8e88-07bbc0d87b15 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38782024-12-21T08:33:39.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 84c40754-5354-4d7d-8e88-07bbc0d87b15 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38792024-12-21T08:33:40.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 12088d66-0a58-4b74-91ac-f4ab566420bf roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38802024-12-21T08:33:40.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 12088d66-0a58-4b74-91ac-f4ab566420bf resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38812024-12-21T08:33:40.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 12088d66-0a58-4b74-91ac-f4ab566420bf response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
38822024-12-21T08:33:41.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 93 reason = Timeout
38832024-12-21T08:33:41.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38842024-12-21T08:33:41.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 93 reason = Timeout
38852024-12-21T08:33:41.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38862024-12-21T08:33:41.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38872024-12-21T08:33:41.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38882024-12-21T08:33:41.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38892024-12-21T08:33:41.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38902024-12-21T08:33:41.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38912024-12-21T08:33:41.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38922024-12-21T08:33:41.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38932024-12-21T08:33:41.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38942024-12-21T08:33:41.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38952024-12-21T08:33:41.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
38962024-12-21T08:33:41.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38972024-12-21T08:33:41.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38982024-12-21T08:33:41.555ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
38992024-12-21T08:33:41.555ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.291746ms iteration = 93 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
39002024-12-21T08:33:41.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39012024-12-21T08:33:41.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39022024-12-21T08:33:41.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.242172ms iteration = 93 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39032024-12-21T08:33:41.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a4eea813-9163-4327-9272-730e488ba20b roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39042024-12-21T08:33:41.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a4eea813-9163-4327-9272-730e488ba20b resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39052024-12-21T08:33:41.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a4eea813-9163-4327-9272-730e488ba20b response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39062024-12-21T08:33:42.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dd4903b9-f122-4a13-a4d1-ce7875fde7f5 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39072024-12-21T08:33:42.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dd4903b9-f122-4a13-a4d1-ce7875fde7f5 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39082024-12-21T08:33:42.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2591 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = dd4903b9-f122-4a13-a4d1-ce7875fde7f5 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39092024-12-21T08:33:43.311ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:33163
39102024-12-21T08:33:43.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33163 req_id = a16582fc-22a6-4e88-a652-240eed425a5e roles = RoleSet { roles: {} } uri = /metrics/producers
39112024-12-21T08:33:43.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33163 req_id = a16582fc-22a6-4e88-a652-240eed425a5e resource = Database result = Ok(()) uri = /metrics/producers
39122024-12-21T08:33:43.353ZINFOnexus: assigned collector to new producer collector_id = d3e17b73-750a-4d54-b6e9-cb13b0984ebb file = nexus/src/app/oximeter.rs:76 producer_id = f9f621dc-581d-45cc-8ebc-94a4d227cdfb
39132024-12-21T08:33:43.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41781 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33163 req_id = a16582fc-22a6-4e88-a652-240eed425a5e response_code = 201 uri = /metrics/producers
39142024-12-21T08:33:43.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 94ce800d-3a63-4c9d-bcbd-58eee2a84e2a roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39152024-12-21T08:33:43.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 94ce800d-3a63-4c9d-bcbd-58eee2a84e2a resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39162024-12-21T08:33:43.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 94ce800d-3a63-4c9d-bcbd-58eee2a84e2a response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39172024-12-21T08:33:44.534ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = 9c8c9c7d-44bc-43c4-9fc1-913168fdd43a response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
39182024-12-21T08:33:44.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 453d749b-556f-4876-96e8-940dac472f0d roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39192024-12-21T08:33:44.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 453d749b-556f-4876-96e8-940dac472f0d resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39202024-12-21T08:33:44.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 453d749b-556f-4876-96e8-940dac472f0d response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39212024-12-21T08:33:45.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2cb58489-6c52-4d0e-8f90-948a4ffabff1 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39222024-12-21T08:33:45.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2cb58489-6c52-4d0e-8f90-948a4ffabff1 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39232024-12-21T08:33:45.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2cb58489-6c52-4d0e-8f90-948a4ffabff1 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39242024-12-21T08:33:46.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = af3b2d3c-fd26-4e8f-8a08-058a306017ac roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39252024-12-21T08:33:46.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = af3b2d3c-fd26-4e8f-8a08-058a306017ac resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39262024-12-21T08:33:46.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = af3b2d3c-fd26-4e8f-8a08-058a306017ac response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39272024-12-21T08:33:47.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 05223dfb-85cc-4e54-8367-5bd104a709d6 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39282024-12-21T08:33:47.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 05223dfb-85cc-4e54-8367-5bd104a709d6 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39292024-12-21T08:33:47.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 05223dfb-85cc-4e54-8367-5bd104a709d6 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39302024-12-21T08:33:48.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d6b33c0f-68e9-4bed-a2c7-4107b5ad6413 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39312024-12-21T08:33:48.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d6b33c0f-68e9-4bed-a2c7-4107b5ad6413 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39322024-12-21T08:33:48.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1680 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = d6b33c0f-68e9-4bed-a2c7-4107b5ad6413 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39332024-12-21T08:33:49.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3e0753bb-c213-4ded-98f3-c1325a9b417f roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39342024-12-21T08:33:49.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3e0753bb-c213-4ded-98f3-c1325a9b417f resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39352024-12-21T08:33:49.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2588 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 3e0753bb-c213-4ded-98f3-c1325a9b417f response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39362024-12-21T08:33:50.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 71c6b612-bb92-4596-8a36-ca29f76b15e8 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39372024-12-21T08:33:50.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 71c6b612-bb92-4596-8a36-ca29f76b15e8 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39382024-12-21T08:33:50.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 71c6b612-bb92-4596-8a36-ca29f76b15e8 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
39392024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 32 reason = Timeout
39402024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39412024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 32 reason = Timeout
39422024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 94 reason = Timeout
39432024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39442024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39452024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 34 reason = Timeout
39462024-12-21T08:33:51.533ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39472024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 32 reason = Timeout
39482024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39492024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39502024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 32 reason = Timeout
39512024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39522024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 32 reason = Timeout
39532024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39542024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 32 reason = Timeout
39552024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 36 reason = Timeout
39562024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39572024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 32 reason = Timeout
39582024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 32 reason = Timeout
39592024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39602024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39612024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 33 reason = Timeout
39622024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39632024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 32 reason = Timeout
39642024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39652024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 94 reason = Timeout
39662024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 33 reason = Timeout
39672024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39682024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39692024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39702024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 32 reason = Timeout
39712024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39722024-12-21T08:33:51.533ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 32 reason = Timeout
39732024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39742024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39752024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39762024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39772024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39782024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39792024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39802024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39812024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39822024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39832024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39842024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39852024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39862024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39872024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39882024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39892024-12-21T08:33:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39902024-12-21T08:33:51.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39912024-12-21T08:33:51.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39922024-12-21T08:33:51.537ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39932024-12-21T08:33:51.537ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.998975ms iteration = 32 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39942024-12-21T08:33:51.538ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39952024-12-21T08:33:51.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39962024-12-21T08:33:51.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39972024-12-21T08:33:51.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39982024-12-21T08:33:51.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39992024-12-21T08:33:51.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40002024-12-21T08:33:51.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40012024-12-21T08:33:51.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40022024-12-21T08:33:51.540ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40032024-12-21T08:33:51.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40042024-12-21T08:33:51.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40052024-12-21T08:33:51.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40062024-12-21T08:33:51.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40072024-12-21T08:33:51.544ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40082024-12-21T08:33:51.544ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40092024-12-21T08:33:51.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40102024-12-21T08:33:51.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40112024-12-21T08:33:51.544ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1913, tv_nsec: 530237721 } })
40122024-12-21T08:33:51.544ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
40132024-12-21T08:33:51.545ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1913, tv_nsec: 530966237 } })
40142024-12-21T08:33:51.545ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
40152024-12-21T08:33:51.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40162024-12-21T08:33:51.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40172024-12-21T08:33:51.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40182024-12-21T08:33:51.547ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.977593ms iteration = 94 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40192024-12-21T08:33:51.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40202024-12-21T08:33:51.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40212024-12-21T08:33:51.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40222024-12-21T08:33:51.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40232024-12-21T08:33:51.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40242024-12-21T08:33:51.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40252024-12-21T08:33:51.551ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40262024-12-21T08:33:51.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40272024-12-21T08:33:51.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40282024-12-21T08:33:51.552ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3b53ba2d-4d00-44a6-bd37-8306adc194ea.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1913, tv_nsec: 538209591 } })
40292024-12-21T08:33:51.553ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
40302024-12-21T08:33:51.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40312024-12-21T08:33:51.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40322024-12-21T08:33:51.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40332024-12-21T08:33:51.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40342024-12-21T08:33:51.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40352024-12-21T08:33:51.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40362024-12-21T08:33:51.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40372024-12-21T08:33:51.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
40382024-12-21T08:33:51.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40392024-12-21T08:33:51.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40402024-12-21T08:33:51.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 37.009776ms iteration = 32 status = {"errors":[],"finish_invoked_ok":[]}
40412024-12-21T08:33:51.579ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
40422024-12-21T08:33:51.579ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.194439ms iteration = 94 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
40432024-12-21T08:33:51.580ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40442024-12-21T08:33:51.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40452024-12-21T08:33:51.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40462024-12-21T08:33:51.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.664398ms iteration = 32 status = {"errors":[],"garbage_collect_requested":[]}
40472024-12-21T08:33:51.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40482024-12-21T08:33:51.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40492024-12-21T08:33:51.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40502024-12-21T08:33:51.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40512024-12-21T08:33:51.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40522024-12-21T08:33:51.589ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40532024-12-21T08:33:51.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40542024-12-21T08:33:51.591ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40552024-12-21T08:33:51.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40562024-12-21T08:33:51.592ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40572024-12-21T08:33:51.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40582024-12-21T08:33:51.593ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40592024-12-21T08:33:51.593ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 59.403913ms iteration = 32 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
40602024-12-21T08:33:51.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40612024-12-21T08:33:51.595ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40622024-12-21T08:33:51.595ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40632024-12-21T08:33:51.595ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40642024-12-21T08:33:51.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40652024-12-21T08:33:51.596ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40662024-12-21T08:33:51.596ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.169957ms iteration = 32 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40672024-12-21T08:33:51.596ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40682024-12-21T08:33:51.596ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40692024-12-21T08:33:51.597ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 63.115147ms iteration = 33 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40702024-12-21T08:33:51.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40712024-12-21T08:33:51.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40722024-12-21T08:33:51.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40732024-12-21T08:33:51.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40742024-12-21T08:33:51.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 79.027687ms iteration = 32 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40752024-12-21T08:33:51.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40762024-12-21T08:33:51.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40772024-12-21T08:33:51.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40782024-12-21T08:33:51.614ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40792024-12-21T08:33:51.614ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40802024-12-21T08:33:51.615ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cf54542-86ca-4ef5-b69b-6dba712282db", "content-length": "26", "date": "Sat, 21 Dec 2024 08:33:51 GMT"} })
40812024-12-21T08:33:51.615ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40822024-12-21T08:33:51.615ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40832024-12-21T08:33:51.615ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40842024-12-21T08:33:51.615ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "37086782-5643-4f9a-8418-bd9df06acc3e", "content-length": "26", "date": "Sat, 21 Dec 2024 08:33:51 GMT"} })
40852024-12-21T08:33:51.616ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40862024-12-21T08:33:51.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3b53ba2d-4d00-44a6-bd37-8306adc194ea, lookup_type: ById(3b53ba2d-4d00-44a6-bd37-8306adc194ea) } result = Ok(())
40872024-12-21T08:33:51.617ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40882024-12-21T08:33:51.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40892024-12-21T08:33:51.618ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40902024-12-21T08:33:51.618ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40912024-12-21T08:33:51.618ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 84.785117ms iteration = 32 status = 0
40922024-12-21T08:33:51.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.971331ms iteration = 32 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40932024-12-21T08:33:51.630ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40942024-12-21T08:33:51.632ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40952024-12-21T08:33:51.632ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40962024-12-21T08:33:51.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40972024-12-21T08:33:51.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40982024-12-21T08:33:51.635ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40992024-12-21T08:33:51.635ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41002024-12-21T08:33:51.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41012024-12-21T08:33:51.638ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 zone_address = fd00:1122:3344:101::2
41022024-12-21T08:33:51.638ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41032024-12-21T08:33:51.638ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "19008155-a079-4fdd-b943-1cf9951773c9", "content-length": "26", "date": "Sat, 21 Dec 2024 08:33:51 GMT"} })
41042024-12-21T08:33:51.638ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41052024-12-21T08:33:51.640ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
41062024-12-21T08:33:51.669ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 135.369804ms iteration = 36 status = {"physical_disks_added":0}
41072024-12-21T08:33:51.737ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41082024-12-21T08:33:51.737ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "594672ad-f5a6-4276-8aba-f4549280c9d4", "content-length": "2", "date": "Sat, 21 Dec 2024 08:33:50 GMT"} })
41092024-12-21T08:33:51.738ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 204.939998ms iteration = 32 status = {}
41102024-12-21T08:33:51.740ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41112024-12-21T08:33:51.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41122024-12-21T08:33:51.742ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 208.301877ms iteration = 32 status = null
41132024-12-21T08:33:51.744ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41142024-12-21T08:33:51.744ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41152024-12-21T08:33:51.745ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "43fa0dd4-50e7-4437-98ec-3e2cac460cfe", "content-length": "372", "date": "Sat, 21 Dec 2024 08:33:51 GMT"} })
41162024-12-21T08:33:51.745ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41172024-12-21T08:33:51.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41182024-12-21T08:33:51.759ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
41192024-12-21T08:33:51.759ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41202024-12-21T08:33:51.759ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ecc8f9e0-579c-4ca3-9cc6-04f5e48f35ea", "date": "Sat, 21 Dec 2024 08:33:51 GMT"} })
41212024-12-21T08:33:51.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41222024-12-21T08:33:51.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41232024-12-21T08:33:51.781ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41242024-12-21T08:33:51.781ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "372cf05d-53cd-4d10-a323-5a5772824ad7", "content-length": "691", "date": "Sat, 21 Dec 2024 08:33:51 GMT"} })
41252024-12-21T08:33:51.781ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
41262024-12-21T08:33:51.781ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
41272024-12-21T08:33:51.781ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
41282024-12-21T08:33:51.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41292024-12-21T08:33:51.783ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 249.566241ms iteration = 33 status = {}
41302024-12-21T08:33:51.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41312024-12-21T08:33:51.786ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41322024-12-21T08:33:51.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41332024-12-21T08:33:51.789ZINFOnexus (BackgroundTasks): VPC route manager sled 3b53ba2d-4d00-44a6-bd37-8306adc194ea push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41342024-12-21T08:33:51.789ZDEBGnexus (BackgroundTasks): client request SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41352024-12-21T08:33:51.789ZDEBGnexus (BackgroundTasks): client response SledAgent = 3b53ba2d-4d00-44a6-bd37-8306adc194ea background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e8c87b09-df93-4c6e-85bc-fa7270c82693", "date": "Sat, 21 Dec 2024 08:33:51 GMT"} })
41362024-12-21T08:33:51.791ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 257.37689ms iteration = 34 status = {}
41372024-12-21T08:33:51.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41382024-12-21T08:33:51.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41392024-12-21T08:33:51.831ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4986737f-c249-4380-901f-c7ce67751b89, rack_id: dcff325a-cbfd-4a8c-805a-d5b8a1a42707, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a98489e0-d62f-4837-a1f0-df124db3049c) } rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0
41402024-12-21T08:33:51.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41412024-12-21T08:33:51.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41422024-12-21T08:33:51.839ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41432024-12-21T08:33:51.840ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "87ddfacc-3642-4361-bbde-fddf88654874", "content-length": "134", "date": "Sat, 21 Dec 2024 08:33:51 GMT"} })
41442024-12-21T08:33:51.840ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
41452024-12-21T08:33:51.840ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a98489e0-d62f-4837-a1f0-df124db3049c
41462024-12-21T08:33:51.840ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41472024-12-21T08:33:51.840ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41482024-12-21T08:33:51.840ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41492024-12-21T08:33:51.840ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41502024-12-21T08:33:51.840ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41512024-12-21T08:33:51.840ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41522024-12-21T08:33:51.840ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41532024-12-21T08:33:51.840ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41542024-12-21T08:33:51.840ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707
41552024-12-21T08:33:51.840ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41562024-12-21T08:33:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41572024-12-21T08:33:51.842ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41582024-12-21T08:33:51.842ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "37d800df-f532-4845-b55b-3286666b1f7b", "content-length": "2", "date": "Sat, 21 Dec 2024 08:33:51 GMT"} })
41592024-12-21T08:33:51.842ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41602024-12-21T08:33:51.843ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a121c19-e5d0-4db5-b76e-f489a2e433b8", "content-length": "52", "date": "Sat, 21 Dec 2024 08:33:51 GMT"} })
41612024-12-21T08:33:51.843ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch_location = Switch0
41622024-12-21T08:33:51.843ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41632024-12-21T08:33:51.967ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "710f7ee1-31a4-4ea0-841b-54134dd7e625", "date": "Sat, 21 Dec 2024 08:33:51 GMT"} })
41642024-12-21T08:33:51.967ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 switch = Switch0
41652024-12-21T08:33:51.967ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41662024-12-21T08:33:51.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f2892bc9-ad07-4d4e-b845-a8a7fd0bdbb5 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41672024-12-21T08:33:51.967ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dcff325a-cbfd-4a8c-805a-d5b8a1a42707 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a2020ed-87d7-465d-8740-a3f3d7ea8532", "content-length": "682", "date": "Sat, 21 Dec 2024 08:33:51 GMT"} })
41682024-12-21T08:33:51.967ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41692024-12-21T08:33:51.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f2892bc9-ad07-4d4e-b845-a8a7fd0bdbb5 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41702024-12-21T08:33:51.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41712024-12-21T08:33:51.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2790 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f2892bc9-ad07-4d4e-b845-a8a7fd0bdbb5 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41722024-12-21T08:33:51.972ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41732024-12-21T08:33:51.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41742024-12-21T08:33:51.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41752024-12-21T08:33:51.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41762024-12-21T08:33:51.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41772024-12-21T08:33:51.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41782024-12-21T08:33:51.987ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 453.104757ms iteration = 32 status = {}
41792024-12-21T08:33:52.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b3ab3417-a3c4-408e-802a-aaed9e8a641a roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41802024-12-21T08:33:52.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b3ab3417-a3c4-408e-802a-aaed9e8a641a resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41812024-12-21T08:33:52.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = b3ab3417-a3c4-408e-802a-aaed9e8a641a response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41822024-12-21T08:33:54.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 86b07e55-c164-4444-b392-d71864ba0625 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41832024-12-21T08:33:54.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 86b07e55-c164-4444-b392-d71864ba0625 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41842024-12-21T08:33:54.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 86b07e55-c164-4444-b392-d71864ba0625 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41852024-12-21T08:33:54.534ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1558 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = f8716103-55ce-47f3-83cd-ceef6db3af64 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
41862024-12-21T08:33:55.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = de43b696-b227-47b4-92f0-0beb39caa567 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41872024-12-21T08:33:55.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = de43b696-b227-47b4-92f0-0beb39caa567 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41882024-12-21T08:33:55.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2927 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = de43b696-b227-47b4-92f0-0beb39caa567 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41892024-12-21T08:33:56.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a16562e2-83f7-476c-bdc6-29925c4019b7 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41902024-12-21T08:33:56.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a16562e2-83f7-476c-bdc6-29925c4019b7 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41912024-12-21T08:33:56.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2619 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a16562e2-83f7-476c-bdc6-29925c4019b7 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41922024-12-21T08:33:57.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f830a6c4-8ca9-444c-b87f-455fb89b2524 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41932024-12-21T08:33:57.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f830a6c4-8ca9-444c-b87f-455fb89b2524 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41942024-12-21T08:33:57.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f830a6c4-8ca9-444c-b87f-455fb89b2524 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41952024-12-21T08:33:58.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2854fd2e-dc05-4408-b3f9-7daae78dc4a4 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41962024-12-21T08:33:58.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2854fd2e-dc05-4408-b3f9-7daae78dc4a4 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41972024-12-21T08:33:58.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2687 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 2854fd2e-dc05-4408-b3f9-7daae78dc4a4 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41982024-12-21T08:33:59.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4ff61e44-1cc5-4b6c-831d-4f622e622ce2 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
41992024-12-21T08:33:59.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4ff61e44-1cc5-4b6c-831d-4f622e622ce2 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42002024-12-21T08:33:59.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4ff61e44-1cc5-4b6c-831d-4f622e622ce2 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42012024-12-21T08:34:00.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 21359e1f-369e-40b8-adb5-213e083c8a65 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42022024-12-21T08:34:00.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 21359e1f-369e-40b8-adb5-213e083c8a65 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42032024-12-21T08:34:00.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 21359e1f-369e-40b8-adb5-213e083c8a65 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42042024-12-21T08:34:01.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 54ba9394-e63d-419e-8d74-a73769ba3fb7 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42052024-12-21T08:34:01.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 54ba9394-e63d-419e-8d74-a73769ba3fb7 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42062024-12-21T08:34:01.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 54ba9394-e63d-419e-8d74-a73769ba3fb7 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42072024-12-21T08:34:01.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 95 reason = Timeout
42082024-12-21T08:34:01.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42092024-12-21T08:34:01.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 95 reason = Timeout
42102024-12-21T08:34:01.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42112024-12-21T08:34:01.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42122024-12-21T08:34:01.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42132024-12-21T08:34:01.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42142024-12-21T08:34:01.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42152024-12-21T08:34:01.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42162024-12-21T08:34:01.537ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.563411ms iteration = 95 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42172024-12-21T08:34:01.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42182024-12-21T08:34:01.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42192024-12-21T08:34:01.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42202024-12-21T08:34:01.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42212024-12-21T08:34:01.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42222024-12-21T08:34:01.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42232024-12-21T08:34:01.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
42242024-12-21T08:34:01.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42252024-12-21T08:34:01.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42262024-12-21T08:34:01.557ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
42272024-12-21T08:34:01.557ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.72283ms iteration = 95 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
42282024-12-21T08:34:02.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 03c739ff-6366-4757-ba76-dd3eff82f82d roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42292024-12-21T08:34:02.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 03c739ff-6366-4757-ba76-dd3eff82f82d resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42302024-12-21T08:34:02.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 03c739ff-6366-4757-ba76-dd3eff82f82d response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42312024-12-21T08:34:03.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 59e2e10b-cd88-468f-8797-eb21409fd2fe roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42322024-12-21T08:34:03.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 59e2e10b-cd88-468f-8797-eb21409fd2fe resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42332024-12-21T08:34:03.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 59e2e10b-cd88-468f-8797-eb21409fd2fe response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42342024-12-21T08:34:04.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a4a65172-f394-4c35-be6f-4373eabdd2a4 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42352024-12-21T08:34:04.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a4a65172-f394-4c35-be6f-4373eabdd2a4 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42362024-12-21T08:34:04.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = a4a65172-f394-4c35-be6f-4373eabdd2a4 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42372024-12-21T08:34:04.501ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:65149
42382024-12-21T08:34:04.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65149 req_id = 45d57c04-935d-41dc-8b1c-321fa5696da1 roles = RoleSet { roles: {} } uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?sort_by=id_ascending
42392024-12-21T08:34:04.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65149 req_id = 45d57c04-935d-41dc-8b1c-321fa5696da1 resource = Database result = Ok(()) uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?sort_by=id_ascending
42402024-12-21T08:34:04.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65149 req_id = 45d57c04-935d-41dc-8b1c-321fa5696da1 response_code = 200 uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?sort_by=id_ascending
42412024-12-21T08:34:04.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65149 req_id = 7900aa24-0d79-4c78-abe8-21281e75344a roles = RoleSet { roles: {} } uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWY2MjFkYy01ODFkLTQ1Y2MtOGViYy05NGE0ZDIyN2NkZmIifX0%3D
42422024-12-21T08:34:04.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65149 req_id = 7900aa24-0d79-4c78-abe8-21281e75344a resource = Database result = Ok(()) uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWY2MjFkYy01ODFkLTQ1Y2MtOGViYy05NGE0ZDIyN2NkZmIifX0%3D
42432024-12-21T08:34:04.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2680 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65149 req_id = 7900aa24-0d79-4c78-abe8-21281e75344a response_code = 200 uri = /metrics/collectors/d3e17b73-750a-4d54-b6e9-cb13b0984ebb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWY2MjFkYy01ODFkLTQ1Y2MtOGViYy05NGE0ZDIyN2NkZmIifX0%3D
42442024-12-21T08:34:04.534ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1320 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = 7215c4f4-b73e-478e-b4ff-118bd769244b response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
42452024-12-21T08:34:05.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = be215c44-ebb1-40d0-8055-f702120624b2 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42462024-12-21T08:34:05.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = be215c44-ebb1-40d0-8055-f702120624b2 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42472024-12-21T08:34:05.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2599 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = be215c44-ebb1-40d0-8055-f702120624b2 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42482024-12-21T08:34:06.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = edf51ae7-66b3-4e66-8292-c68ec3b443ee roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
42492024-12-21T08:34:06.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = edf51ae7-66b3-4e66-8292-c68ec3b443ee resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
42502024-12-21T08:34:06.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57944 req_id = edf51ae7-66b3-4e66-8292-c68ec3b443ee response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
42512024-12-21T08:34:06.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09e0691a-b2e1-43bc-a88a-a4742cc5aa98 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42522024-12-21T08:34:06.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09e0691a-b2e1-43bc-a88a-a4742cc5aa98 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42532024-12-21T08:34:06.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2630 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 09e0691a-b2e1-43bc-a88a-a4742cc5aa98 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42542024-12-21T08:34:07.254ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:60250
42552024-12-21T08:34:07.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60250 req_id = 522e5f17-304e-401c-b04c-478fb2ff755e roles = RoleSet { roles: {} } uri = /metrics/producers
42562024-12-21T08:34:07.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60250 req_id = 522e5f17-304e-401c-b04c-478fb2ff755e resource = Database result = Ok(()) uri = /metrics/producers
42572024-12-21T08:34:07.291ZINFOnexus: assigned collector to new producer collector_id = d3e17b73-750a-4d54-b6e9-cb13b0984ebb file = nexus/src/app/oximeter.rs:76 producer_id = 41e6f272-71a8-4e23-be23-2506b7b8fb0f
42582024-12-21T08:34:07.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37561 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60250 req_id = 522e5f17-304e-401c-b04c-478fb2ff755e response_code = 201 uri = /metrics/producers
42592024-12-21T08:34:07.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4af9b20e-5351-469a-9537-7cb8a45af3c6 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42602024-12-21T08:34:07.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4af9b20e-5351-469a-9537-7cb8a45af3c6 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42612024-12-21T08:34:07.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 4af9b20e-5351-469a-9537-7cb8a45af3c6 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42622024-12-21T08:34:08.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9198e495-96aa-4505-b54c-0980fd125b47 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42632024-12-21T08:34:08.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9198e495-96aa-4505-b54c-0980fd125b47 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42642024-12-21T08:34:08.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 9198e495-96aa-4505-b54c-0980fd125b47 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42652024-12-21T08:34:09.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f745b032-3b35-48ed-ab0b-7bff85f7e1ad roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42662024-12-21T08:34:09.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f745b032-3b35-48ed-ab0b-7bff85f7e1ad resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42672024-12-21T08:34:09.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2733 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = f745b032-3b35-48ed-ab0b-7bff85f7e1ad response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42682024-12-21T08:34:10.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 80721cc4-8ead-4c39-9ee6-dbf482cba49f roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42692024-12-21T08:34:10.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 80721cc4-8ead-4c39-9ee6-dbf482cba49f resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42702024-12-21T08:34:10.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 80721cc4-8ead-4c39-9ee6-dbf482cba49f response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42712024-12-21T08:34:11.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = db0e1ed1-7d46-4ec0-80d0-96158a810928 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42722024-12-21T08:34:11.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = db0e1ed1-7d46-4ec0-80d0-96158a810928 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42732024-12-21T08:34:11.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1827 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = db0e1ed1-7d46-4ec0-80d0-96158a810928 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42742024-12-21T08:34:11.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 96 reason = Timeout
42752024-12-21T08:34:11.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 96 reason = Timeout
42762024-12-21T08:34:11.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42772024-12-21T08:34:11.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42782024-12-21T08:34:11.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42792024-12-21T08:34:11.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42802024-12-21T08:34:11.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42812024-12-21T08:34:11.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42822024-12-21T08:34:11.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42832024-12-21T08:34:11.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42842024-12-21T08:34:11.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42852024-12-21T08:34:11.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42862024-12-21T08:34:11.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42872024-12-21T08:34:11.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a9dd3b0d-8b1b-49d4-9c99-776368ce2302, lookup_type: ById(a9dd3b0d-8b1b-49d4-9c99-776368ce2302) } result = Ok(())
42882024-12-21T08:34:11.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42892024-12-21T08:34:11.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42902024-12-21T08:34:11.557ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 original_time_created = 2024-12-21 08:18:10.338214 UTC target_id = a9dd3b0d-8b1b-49d4-9c99-776368ce2302 time_created = 2024-12-21 08:18:10.338214 UTC
42912024-12-21T08:34:11.557ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.78948ms iteration = 96 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"a9dd3b0d-8b1b-49d4-9c99-776368ce2302","time_created":"2024-12-21T08:18:10.338214Z"}
42922024-12-21T08:34:11.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42932024-12-21T08:34:11.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42942024-12-21T08:34:11.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.887551ms iteration = 96 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42952024-12-21T08:34:12.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ea280f01-45a8-4787-b4d2-28b8669f39bd roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42962024-12-21T08:34:12.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ea280f01-45a8-4787-b4d2-28b8669f39bd resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42972024-12-21T08:34:12.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = ea280f01-45a8-4787-b4d2-28b8669f39bd response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42982024-12-21T08:34:13.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 14853f97-6343-4db5-85c6-72838f4cc2bc roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
42992024-12-21T08:34:13.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 14853f97-6343-4db5-85c6-72838f4cc2bc resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
43002024-12-21T08:34:13.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 14853f97-6343-4db5-85c6-72838f4cc2bc response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
43012024-12-21T08:34:14.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 78afd1cb-2872-45f4-a9b2-3b0d6529a288 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
43022024-12-21T08:34:14.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 78afd1cb-2872-45f4-a9b2-3b0d6529a288 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
43032024-12-21T08:34:14.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 78afd1cb-2872-45f4-a9b2-3b0d6529a288 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
43042024-12-21T08:34:14.535ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1742 local_addr = [fd00:1122:3344:101::b]:46048 method = GET remote_addr = [fd00:1122:3344:101::d]:45525 req_id = 907c2de4-c56d-489c-9bf6-b97f5875d0a0 response_code = 200 uri = /4a1e80ef-44d3-4759-a693-2db4746da02d
43052024-12-21T08:34:15.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 212216db-3d0a-473d-83d7-46519c3beb26 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
43062024-12-21T08:34:15.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 212216db-3d0a-473d-83d7-46519c3beb26 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
43072024-12-21T08:34:15.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 212216db-3d0a-473d-83d7-46519c3beb26 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
43082024-12-21T08:34:16.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 032bd9f4-3bf6-49f4-a921-dc5c909a9ae0 roles = RoleSet { roles: {} } uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
43092024-12-21T08:34:16.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 032bd9f4-3bf6-49f4-a921-dc5c909a9ae0 resource = Database result = Ok(()) uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea
43102024-12-21T08:34:16.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2659 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53103 req_id = 032bd9f4-3bf6-49f4-a921-dc5c909a9ae0 response_code = 200 uri = /probes/3b53ba2d-4d00-44a6-bd37-8306adc194ea