Max level shown:
12024-11-14T17:00:03.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ce1fe1f9-5aa5-49dd-b91f-11cb4529010d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
22024-11-14T17:00:03.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ce1fe1f9-5aa5-49dd-b91f-11cb4529010d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32024-11-14T17:00:03.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ce1fe1f9-5aa5-49dd-b91f-11cb4529010d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
42024-11-14T17:00:04.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ca8e1f24-8279-4580-95f2-384505b4757c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
52024-11-14T17:00:04.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ca8e1f24-8279-4580-95f2-384505b4757c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62024-11-14T17:00:04.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ca8e1f24-8279-4580-95f2-384505b4757c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
72024-11-14T17:00:05.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1b0920e0-1259-4879-aec2-e76bec2df413 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
82024-11-14T17:00:05.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1b0920e0-1259-4879-aec2-e76bec2df413 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
92024-11-14T17:00:05.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1b0920e0-1259-4879-aec2-e76bec2df413 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
102024-11-14T17:00:06.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fd78f137-020a-44da-adaf-d7db158099af roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
112024-11-14T17:00:06.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fd78f137-020a-44da-adaf-d7db158099af resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
122024-11-14T17:00:06.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fd78f137-020a-44da-adaf-d7db158099af response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
132024-11-14T17:00:06.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
142024-11-14T17:00:06.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
152024-11-14T17:00:06.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
162024-11-14T17:00:06.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
172024-11-14T17:00:06.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
182024-11-14T17:00:06.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
192024-11-14T17:00:06.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
202024-11-14T17:00:06.711ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
212024-11-14T17:00:06.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
222024-11-14T17:00:06.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
232024-11-14T17:00:06.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
242024-11-14T17:00:06.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
252024-11-14T17:00:06.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
262024-11-14T17:00:06.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
272024-11-14T17:00:06.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
282024-11-14T17:00:06.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
292024-11-14T17:00:06.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
302024-11-14T17:00:06.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
312024-11-14T17:00:06.730ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
322024-11-14T17:00:06.731ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.774153ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
332024-11-14T17:00:06.741ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.839911ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
342024-11-14T17:00:07.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 005c0ac0-6e5f-4e7d-8467-e90d6ddb238d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
352024-11-14T17:00:07.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 005c0ac0-6e5f-4e7d-8467-e90d6ddb238d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
362024-11-14T17:00:07.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 005c0ac0-6e5f-4e7d-8467-e90d6ddb238d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
372024-11-14T17:00:08.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b04cd5e1-0876-43c2-b6cf-6383d1d66769 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
382024-11-14T17:00:08.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b04cd5e1-0876-43c2-b6cf-6383d1d66769 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
392024-11-14T17:00:08.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1677 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b04cd5e1-0876-43c2-b6cf-6383d1d66769 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
402024-11-14T17:00:09.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5f72b256-b2c7-4168-81b3-1c6db73e5c7a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
412024-11-14T17:00:09.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5f72b256-b2c7-4168-81b3-1c6db73e5c7a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
422024-11-14T17:00:09.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5f72b256-b2c7-4168-81b3-1c6db73e5c7a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
432024-11-14T17:00:10.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f2c01b3a-3706-4885-93ac-8dc1d5522c9a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
442024-11-14T17:00:10.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f2c01b3a-3706-4885-93ac-8dc1d5522c9a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
452024-11-14T17:00:10.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f2c01b3a-3706-4885-93ac-8dc1d5522c9a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
462024-11-14T17:00:11.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f867612d-d90f-42b2-8386-70b205305b20 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
472024-11-14T17:00:11.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f867612d-d90f-42b2-8386-70b205305b20 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
482024-11-14T17:00:11.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f867612d-d90f-42b2-8386-70b205305b20 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
492024-11-14T17:00:11.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 3982af9f-58e7-4310-b7d9-8b7da27a55eb response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
502024-11-14T17:00:12.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a77fe33f-1bab-4908-8e07-02713b4038d5 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
512024-11-14T17:00:12.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a77fe33f-1bab-4908-8e07-02713b4038d5 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
522024-11-14T17:00:12.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a77fe33f-1bab-4908-8e07-02713b4038d5 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
532024-11-14T17:00:13.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 069794a3-ecc2-4294-abec-bcdfbf99b7f0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
542024-11-14T17:00:13.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 069794a3-ecc2-4294-abec-bcdfbf99b7f0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
552024-11-14T17:00:13.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 069794a3-ecc2-4294-abec-bcdfbf99b7f0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
562024-11-14T17:00:14.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ee6014be-0441-4e33-a0ef-4042f84e9a3c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
572024-11-14T17:00:14.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ee6014be-0441-4e33-a0ef-4042f84e9a3c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
582024-11-14T17:00:14.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ee6014be-0441-4e33-a0ef-4042f84e9a3c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
592024-11-14T17:00:15.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 53386c70-b2c5-4d89-8e9d-cd9496cc0ec4 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
602024-11-14T17:00:15.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 53386c70-b2c5-4d89-8e9d-cd9496cc0ec4 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
612024-11-14T17:00:15.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 53386c70-b2c5-4d89-8e9d-cd9496cc0ec4 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
622024-11-14T17:00:16.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7ce0b30d-7090-45e3-b370-dcd5f0cf62e0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
632024-11-14T17:00:16.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7ce0b30d-7090-45e3-b370-dcd5f0cf62e0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
642024-11-14T17:00:16.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7ce0b30d-7090-45e3-b370-dcd5f0cf62e0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
652024-11-14T17:00:16.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62673 req_id = 3f719fd3-ad9b-4744-929d-5b777166df8f roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
662024-11-14T17:00:16.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62673 req_id = 3f719fd3-ad9b-4744-929d-5b777166df8f resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
672024-11-14T17:00:16.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62673 req_id = 3f719fd3-ad9b-4744-929d-5b777166df8f response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
682024-11-14T17:00:16.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62673 req_id = 2bbec0c4-7519-458b-be53-f4e600558d13 roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
692024-11-14T17:00:16.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62673 req_id = 2bbec0c4-7519-458b-be53-f4e600558d13 resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
702024-11-14T17:00:16.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62673 req_id = 2bbec0c4-7519-458b-be53-f4e600558d13 response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
712024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
722024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
732024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
742024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
752024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
762024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
772024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
782024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
792024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
802024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
812024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
822024-11-14T17:00:16.708ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 16:50:16.708306181 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
832024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
842024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
852024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
862024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
872024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
882024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
892024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
902024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
912024-11-14T17:00:16.708ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
922024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
932024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
942024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
952024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
962024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
972024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
982024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
992024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1002024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1012024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
1022024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1032024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
1042024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1052024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1062024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
1072024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1082024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
1092024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1102024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
1112024-11-14T17:00:16.708ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1122024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1132024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
1142024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
1152024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1162024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
1172024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1182024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
1192024-11-14T17:00:16.708ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5
1202024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
1212024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.801\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5"}
1222024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1232024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
1242024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1252024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
1262024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1272024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1282024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
1292024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1302024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
1312024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1322024-11-14T17:00:16.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1332024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
1342024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
1352024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1362024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1372024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1382024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1392024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1402024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1412024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1422024-11-14T17:00:16.709ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94482e71-9503-4d09-b73f-615fbf343a2e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2140, tv_nsec: 439800712 } })
1432024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1442024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1452024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1462024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1472024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1482024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1492024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1502024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1512024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1522024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1532024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1542024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1552024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1562024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1572024-11-14T17:00:16.709ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89b01be2-c37f-445d-addd-6b4be9cd73c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc5fdca1-6d92-4ff4-b5ae-2f44553a2186.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2140, tv_nsec: 439971295 } })
1582024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1592024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1602024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1612024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1622024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1632024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1642024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1652024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
1662024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.320729ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
1672024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
1682024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.348561ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
1692024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1702024-11-14T17:00:16.709ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1712024-11-14T17:00:16.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1722024-11-14T17:00:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1732024-11-14T17:00:16.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1742024-11-14T17:00:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1752024-11-14T17:00:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1762024-11-14T17:00:16.711ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1772024-11-14T17:00:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1782024-11-14T17:00:16.712ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 16:50:16.708306181 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1792024-11-14T17:00:16.712ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.941989ms iteration = 7 status = {"expiration":"2024-11-14T16:50:16.708306181Z","pruned":[]}
1802024-11-14T17:00:16.712ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.01217ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1812024-11-14T17:00:16.714ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2140, tv_nsec: 445593842 } })
1822024-11-14T17:00:16.715ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
1832024-11-14T17:00:16.715ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2140, tv_nsec: 446233717 } })
1842024-11-14T17:00:16.715ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
1852024-11-14T17:00:16.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1862024-11-14T17:00:16.718ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1872024-11-14T17:00:16.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1882024-11-14T17:00:16.719ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1892024-11-14T17:00:16.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1902024-11-14T17:00:16.720ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1912024-11-14T17:00:16.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1922024-11-14T17:00:16.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1932024-11-14T17:00:16.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1942024-11-14T17:00:16.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1952024-11-14T17:00:16.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1962024-11-14T17:00:16.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1972024-11-14T17:00:16.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1982024-11-14T17:00:16.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1992024-11-14T17:00:16.730ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2002024-11-14T17:00:16.731ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2012024-11-14T17:00:16.732ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.988212ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
2022024-11-14T17:00:16.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2032024-11-14T17:00:16.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2042024-11-14T17:00:16.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2052024-11-14T17:00:16.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2062024-11-14T17:00:16.734ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2072024-11-14T17:00:16.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2082024-11-14T17:00:16.743ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2092024-11-14T17:00:16.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2102024-11-14T17:00:16.746ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2112024-11-14T17:00:16.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2122024-11-14T17:00:16.746ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2132024-11-14T17:00:16.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2142024-11-14T17:00:16.749ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2152024-11-14T17:00:16.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2162024-11-14T17:00:16.754ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2172024-11-14T17:00:16.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2182024-11-14T17:00:16.770ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2192024-11-14T17:00:16.770ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2202024-11-14T17:00:16.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2212024-11-14T17:00:16.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2222024-11-14T17:00:16.778ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2232024-11-14T17:00:16.778ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2242024-11-14T17:00:16.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2252024-11-14T17:00:16.781ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2262024-11-14T17:00:16.781ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2272024-11-14T17:00:16.782ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2282024-11-14T17:00:16.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2292024-11-14T17:00:16.782ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2302024-11-14T17:00:16.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2312024-11-14T17:00:16.782ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2322024-11-14T17:00:16.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2332024-11-14T17:00:16.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2342024-11-14T17:00:16.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2352024-11-14T17:00:16.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2362024-11-14T17:00:16.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2372024-11-14T17:00:16.783ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2382024-11-14T17:00:16.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2392024-11-14T17:00:16.786ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2402024-11-14T17:00:16.786ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2412024-11-14T17:00:16.786ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2422024-11-14T17:00:16.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2432024-11-14T17:00:16.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2442024-11-14T17:00:16.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2452024-11-14T17:00:16.790ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2462024-11-14T17:00:16.790ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2472024-11-14T17:00:16.790ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 81.632232ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2482024-11-14T17:00:16.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2492024-11-14T17:00:16.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2502024-11-14T17:00:16.792ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 83.287669ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
2512024-11-14T17:00:16.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2522024-11-14T17:00:16.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2532024-11-14T17:00:16.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2542024-11-14T17:00:16.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 94.110784ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
2552024-11-14T17:00:16.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2562024-11-14T17:00:16.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2572024-11-14T17:00:16.807ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2582024-11-14T17:00:16.807ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2592024-11-14T17:00:16.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 99.154527ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2602024-11-14T17:00:16.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2612024-11-14T17:00:16.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2622024-11-14T17:00:16.810ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2632024-11-14T17:00:16.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2642024-11-14T17:00:16.811ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2652024-11-14T17:00:16.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2662024-11-14T17:00:16.815ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2672024-11-14T17:00:16.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2682024-11-14T17:00:16.818ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2692024-11-14T17:00:16.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2702024-11-14T17:00:16.828ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2712024-11-14T17:00:16.828ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2722024-11-14T17:00:16.828ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2732024-11-14T17:00:16.828ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2742024-11-14T17:00:16.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2752024-11-14T17:00:16.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
2762024-11-14T17:00:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2772024-11-14T17:00:16.857ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2782024-11-14T17:00:16.857ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 149.254178ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2792024-11-14T17:00:16.862ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
2802024-11-14T17:00:16.874ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2812024-11-14T17:00:16.874ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2822024-11-14T17:00:16.874ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2832024-11-14T17:00:16.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2842024-11-14T17:00:16.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2852024-11-14T17:00:16.878ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
2862024-11-14T17:00:16.878ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2872024-11-14T17:00:16.879ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d1e248e-2479-4402-914f-e6278198dd6c", "content-length": "26", "date": "Thu, 14 Nov 2024 17:00:16 GMT"} })
2882024-11-14T17:00:16.879ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2892024-11-14T17:00:16.881ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2902024-11-14T17:00:17.012ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
2912024-11-14T17:00:17.025ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2922024-11-14T17:00:17.026ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0094e5a2-0190-455f-929d-9c702aa5b745", "content-length": "1", "date": "Thu, 14 Nov 2024 17:00:16 GMT"} })
2932024-11-14T17:00:17.027ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2942024-11-14T17:00:17.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2952024-11-14T17:00:17.049ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
2962024-11-14T17:00:17.050ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "26cabe12-1c14-424b-bd31-4d926be8767e", "date": "Thu, 14 Nov 2024 17:00:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
2972024-11-14T17:00:17.050ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
2982024-11-14T17:00:17.052ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "afe27965-7588-4218-a809-c1f62c05aac3", "date": "Thu, 14 Nov 2024 17:00:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
2992024-11-14T17:00:17.052ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3002024-11-14T17:00:17.054ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3012024-11-14T17:00:17.054ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 345.72558ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
3022024-11-14T17:00:17.060ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
3032024-11-14T17:00:17.060ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3042024-11-14T17:00:17.060ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4e337ae-a48a-486a-8090-c607ecdba8ab", "content-length": "26", "date": "Thu, 14 Nov 2024 17:00:16 GMT"} })
3052024-11-14T17:00:17.060ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3062024-11-14T17:00:17.062ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3072024-11-14T17:00:17.116ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3082024-11-14T17:00:17.116ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3092024-11-14T17:00:17.117ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bdbedc1-fefb-40c9-a00f-9cfa16903c26", "content-length": "372", "date": "Thu, 14 Nov 2024 17:00:17 GMT"} })
3102024-11-14T17:00:17.117ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3112024-11-14T17:00:17.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3122024-11-14T17:00:17.122ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3132024-11-14T17:00:17.122ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2140, tv_nsec: 852884201 } })
3142024-11-14T17:00:17.122ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
3152024-11-14T17:00:17.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3162024-11-14T17:00:17.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3172024-11-14T17:00:17.123ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3182024-11-14T17:00:17.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3192024-11-14T17:00:17.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
3202024-11-14T17:00:17.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3212024-11-14T17:00:17.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3222024-11-14T17:00:17.130ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 421.627323ms iteration = 4 status = {"nsuccess":5}
3232024-11-14T17:00:17.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3242024-11-14T17:00:17.132ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 424.285063ms iteration = 13 status = null
3252024-11-14T17:00:17.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3262024-11-14T17:00:17.134ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3272024-11-14T17:00:17.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3282024-11-14T17:00:17.135ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3292024-11-14T17:00:17.137ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3302024-11-14T17:00:17.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3312024-11-14T17:00:17.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3322024-11-14T17:00:17.140ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3332024-11-14T17:00:17.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3342024-11-14T17:00:17.143ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3352024-11-14T17:00:17.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3362024-11-14T17:00:17.145ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3372024-11-14T17:00:17.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
3382024-11-14T17:00:17.148ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3392024-11-14T17:00:17.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3402024-11-14T17:00:17.150ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
3412024-11-14T17:00:17.150ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 441.543362ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
3422024-11-14T17:00:17.151ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 443.450715ms iteration = 13 status = 0
3432024-11-14T17:00:17.153ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3442024-11-14T17:00:17.153ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3452024-11-14T17:00:17.153ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3462024-11-14T17:00:17.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3472024-11-14T17:00:17.165ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 456.727855ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3482024-11-14T17:00:17.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 458.014474ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
3492024-11-14T17:00:17.168ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3502024-11-14T17:00:17.168ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
3512024-11-14T17:00:17.168ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 460.396437ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3522024-11-14T17:00:17.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3532024-11-14T17:00:17.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3542024-11-14T17:00:17.173ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3552024-11-14T17:00:17.173ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3562024-11-14T17:00:17.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3572024-11-14T17:00:17.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3582024-11-14T17:00:17.177ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3592024-11-14T17:00:17.177ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3602024-11-14T17:00:17.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3612024-11-14T17:00:17.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3622024-11-14T17:00:17.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3632024-11-14T17:00:17.180ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3642024-11-14T17:00:17.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3652024-11-14T17:00:17.181ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 472.839418ms iteration = 13 status = {}
3662024-11-14T17:00:17.188ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3672024-11-14T17:00:17.188ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3682024-11-14T17:00:17.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3692024-11-14T17:00:17.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3702024-11-14T17:00:17.188ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3712024-11-14T17:00:17.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3722024-11-14T17:00:17.192ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3732024-11-14T17:00:17.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3742024-11-14T17:00:17.194ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
3752024-11-14T17:00:17.194ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3762024-11-14T17:00:17.194ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a17b686a-4f9c-4b2b-9953-034904fd1878", "date": "Thu, 14 Nov 2024 17:00:17 GMT"} })
3772024-11-14T17:00:17.194ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3782024-11-14T17:00:17.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3792024-11-14T17:00:17.197ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3802024-11-14T17:00:17.197ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3812024-11-14T17:00:17.197ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3822024-11-14T17:00:17.197ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 489.354821ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3832024-11-14T17:00:17.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3842024-11-14T17:00:17.204ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3852024-11-14T17:00:17.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3862024-11-14T17:00:17.206ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
3872024-11-14T17:00:17.206ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3882024-11-14T17:00:17.206ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "623b00bb-d38f-4262-b08a-e95a25347ba7", "content-length": "26", "date": "Thu, 14 Nov 2024 17:00:17 GMT"} })
3892024-11-14T17:00:17.206ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3902024-11-14T17:00:17.209ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3912024-11-14T17:00:17.209ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3922024-11-14T17:00:17.209ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
3932024-11-14T17:00:17.209ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "99c5df08-2773-4fb3-b66e-360f28a9c7cf", "date": "Thu, 14 Nov 2024 17:00:17 GMT"} })
3942024-11-14T17:00:17.211ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 502.984709ms iteration = 14 status = {}
3952024-11-14T17:00:17.217ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 508.769959ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
3962024-11-14T17:00:17.226ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T16:54:14.392760Z, time_modified: 2024-11-14T16:54:14.392760Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }) }
3972024-11-14T17:00:17.226ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 517.994497ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]}},"default_endpoint":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3982024-11-14T17:00:17.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3992024-11-14T17:00:17.231ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
4002024-11-14T17:00:17.231ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 0 version = 2
4012024-11-14T17:00:17.231ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4022024-11-14T17:00:17.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4032024-11-14T17:00:17.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4042024-11-14T17:00:17.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4052024-11-14T17:00:17.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4062024-11-14T17:00:17.233ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4072024-11-14T17:00:17.236ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
4082024-11-14T17:00:17.236ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
4092024-11-14T17:00:17.236ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 16:54:46.198050 UTC dns_group = internal generation = 1
4102024-11-14T17:00:17.236ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 527.737227ms iteration = 8 status = {"generation":1}
4112024-11-14T17:00:17.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4122024-11-14T17:00:17.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4132024-11-14T17:00:17.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4142024-11-14T17:00:17.240ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 1 version = 2
4152024-11-14T17:00:17.240ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
4162024-11-14T17:00:17.240ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 16:54:47.468912 UTC dns_group = external generation = 2
4172024-11-14T17:00:17.240ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 531.89708ms iteration = 8 status = {"generation":2}
4182024-11-14T17:00:17.245ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
4192024-11-14T17:00:17.246ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "554a8b47-8da1-4d35-b681-7789f7095773", "date": "Thu, 14 Nov 2024 17:00:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
4202024-11-14T17:00:17.246ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
4212024-11-14T17:00:17.247ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4b797ae8-5a74-4e62-8d39-5f230fa9c8f5", "date": "Thu, 14 Nov 2024 17:00:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
4222024-11-14T17:00:17.247ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
4232024-11-14T17:00:17.249ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2c5b29e6-02c5-448b-8587-f2780db4984a", "date": "Thu, 14 Nov 2024 17:00:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
4242024-11-14T17:00:17.249ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
4252024-11-14T17:00:17.250ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
4262024-11-14T17:00:17.251ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 542.424389ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4272024-11-14T17:00:17.259ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4282024-11-14T17:00:17.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4292024-11-14T17:00:17.261ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4302024-11-14T17:00:17.263ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4312024-11-14T17:00:17.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4322024-11-14T17:00:17.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4332024-11-14T17:00:17.264ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
4342024-11-14T17:00:17.265ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 556.440834ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4352024-11-14T17:00:17.265ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4362024-11-14T17:00:17.267ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4372024-11-14T17:00:17.267ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4382024-11-14T17:00:17.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4392024-11-14T17:00:17.340ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4402024-11-14T17:00:17.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4412024-11-14T17:00:17.342ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
4422024-11-14T17:00:17.342ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4432024-11-14T17:00:17.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4442024-11-14T17:00:17.353ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4452024-11-14T17:00:17.353ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7eea379-80c1-4dbb-b5d3-4f3faae461b5", "content-length": "134", "date": "Thu, 14 Nov 2024 17:00:17 GMT"} })
4462024-11-14T17:00:17.353ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4472024-11-14T17:00:17.353ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
4482024-11-14T17:00:17.353ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4492024-11-14T17:00:17.353ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4502024-11-14T17:00:17.353ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4512024-11-14T17:00:17.353ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4522024-11-14T17:00:17.353ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4532024-11-14T17:00:17.353ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4542024-11-14T17:00:17.354ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4552024-11-14T17:00:17.354ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4562024-11-14T17:00:17.354ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
4572024-11-14T17:00:17.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4582024-11-14T17:00:17.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4592024-11-14T17:00:17.356ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4602024-11-14T17:00:17.356ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "89cbd116-08f4-4045-9b19-48552c9edbba", "content-length": "2", "date": "Thu, 14 Nov 2024 17:00:17 GMT"} })
4612024-11-14T17:00:17.356ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4622024-11-14T17:00:17.356ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7152612c-d24c-49a4-8578-2d1c16f20564", "content-length": "52", "date": "Thu, 14 Nov 2024 17:00:17 GMT"} })
4632024-11-14T17:00:17.356ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
4642024-11-14T17:00:17.356ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4652024-11-14T17:00:17.365ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4662024-11-14T17:00:17.408ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 699.8144ms iteration = 16 status = {"physical_disks_added":0}
4672024-11-14T17:00:17.476ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7414aa3e-de42-4fb8-a39c-697fb602bffc", "date": "Thu, 14 Nov 2024 17:00:17 GMT"} })
4682024-11-14T17:00:17.476ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
4692024-11-14T17:00:17.476ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4702024-11-14T17:00:17.482ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac2cb77b-dc68-4b2e-93b7-0000c5e8d2d4", "content-length": "691", "date": "Thu, 14 Nov 2024 17:00:17 GMT"} })
4712024-11-14T17:00:17.482ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
4722024-11-14T17:00:17.482ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
4732024-11-14T17:00:17.482ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
4742024-11-14T17:00:17.482ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5cec3d41-21b4-4e24-8ca0-22854084d506", "content-length": "682", "date": "Thu, 14 Nov 2024 17:00:17 GMT"} })
4752024-11-14T17:00:17.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4762024-11-14T17:00:17.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4772024-11-14T17:00:17.485ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 776.9634ms iteration = 13 status = {}
4782024-11-14T17:00:17.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4792024-11-14T17:00:17.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4802024-11-14T17:00:17.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4812024-11-14T17:00:17.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4822024-11-14T17:00:17.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4832024-11-14T17:00:17.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4842024-11-14T17:00:17.504ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 795.627021ms iteration = 13 status = {}
4852024-11-14T17:00:17.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6eea8f2e-b07c-44e2-b0b8-a0acb5f2dd0d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
4862024-11-14T17:00:17.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6eea8f2e-b07c-44e2-b0b8-a0acb5f2dd0d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
4872024-11-14T17:00:17.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6eea8f2e-b07c-44e2-b0b8-a0acb5f2dd0d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
4882024-11-14T17:00:17.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 5180e449-2560-4384-9ba7-2a5f0b6563d5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
4892024-11-14T17:00:17.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 5180e449-2560-4384-9ba7-2a5f0b6563d5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
4902024-11-14T17:00:17.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 5180e449-2560-4384-9ba7-2a5f0b6563d5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
4912024-11-14T17:00:18.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d106ef8b-e6d7-402c-9ca1-6f1bc88ebbfd roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
4922024-11-14T17:00:18.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d106ef8b-e6d7-402c-9ca1-6f1bc88ebbfd resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
4932024-11-14T17:00:18.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2672 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d106ef8b-e6d7-402c-9ca1-6f1bc88ebbfd response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
4942024-11-14T17:00:19.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d3f6f02a-ede6-4880-92b3-8a070f285469 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
4952024-11-14T17:00:19.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d3f6f02a-ede6-4880-92b3-8a070f285469 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
4962024-11-14T17:00:19.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d3f6f02a-ede6-4880-92b3-8a070f285469 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
4972024-11-14T17:00:20.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 265698c3-11aa-44b0-bd89-f9e8e832e256 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
4982024-11-14T17:00:20.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 265698c3-11aa-44b0-bd89-f9e8e832e256 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
4992024-11-14T17:00:20.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 265698c3-11aa-44b0-bd89-f9e8e832e256 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5002024-11-14T17:00:21.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 787fb367-c28c-4700-bc1f-01cf417414d5 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5012024-11-14T17:00:21.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 787fb367-c28c-4700-bc1f-01cf417414d5 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5022024-11-14T17:00:21.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 787fb367-c28c-4700-bc1f-01cf417414d5 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5032024-11-14T17:00:22.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 35ca2a64-e648-4386-99fb-a2cf9b449526 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5042024-11-14T17:00:22.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 35ca2a64-e648-4386-99fb-a2cf9b449526 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5052024-11-14T17:00:22.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 35ca2a64-e648-4386-99fb-a2cf9b449526 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5062024-11-14T17:00:23.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 399343aa-fb44-450f-baa7-3d02faf379b0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5072024-11-14T17:00:23.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 399343aa-fb44-450f-baa7-3d02faf379b0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5082024-11-14T17:00:23.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 399343aa-fb44-450f-baa7-3d02faf379b0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5092024-11-14T17:00:24.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = baca201a-a0d5-47ae-873e-6f289859c392 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5102024-11-14T17:00:24.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = baca201a-a0d5-47ae-873e-6f289859c392 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5112024-11-14T17:00:24.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = baca201a-a0d5-47ae-873e-6f289859c392 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5122024-11-14T17:00:25.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 008d978f-67db-4d1e-be58-83c6fa99d8c1 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5132024-11-14T17:00:25.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 008d978f-67db-4d1e-be58-83c6fa99d8c1 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5142024-11-14T17:00:25.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1672 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 008d978f-67db-4d1e-be58-83c6fa99d8c1 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5152024-11-14T17:00:26.604ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1478 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = bcc0d3c9-eeef-48c7-a2f7-9ab88cf079a9 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
5162024-11-14T17:00:26.707ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
5172024-11-14T17:00:26.707ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
5182024-11-14T17:00:26.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5192024-11-14T17:00:26.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5202024-11-14T17:00:26.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5212024-11-14T17:00:26.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5222024-11-14T17:00:26.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5232024-11-14T17:00:26.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5242024-11-14T17:00:26.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5252024-11-14T17:00:26.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5262024-11-14T17:00:26.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5272024-11-14T17:00:26.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5282024-11-14T17:00:26.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5292024-11-14T17:00:26.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5302024-11-14T17:00:26.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5312024-11-14T17:00:26.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
5322024-11-14T17:00:26.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5332024-11-14T17:00:26.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5342024-11-14T17:00:26.731ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
5352024-11-14T17:00:26.731ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.608243ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
5362024-11-14T17:00:26.745ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.023146ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5372024-11-14T17:00:26.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d544d1cd-d20e-45fd-b3cb-9074c9180a82 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5382024-11-14T17:00:26.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d544d1cd-d20e-45fd-b3cb-9074c9180a82 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5392024-11-14T17:00:26.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d544d1cd-d20e-45fd-b3cb-9074c9180a82 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5402024-11-14T17:00:27.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f4c77d1f-a616-4792-9c25-7b15c1f46747 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5412024-11-14T17:00:27.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f4c77d1f-a616-4792-9c25-7b15c1f46747 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5422024-11-14T17:00:27.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f4c77d1f-a616-4792-9c25-7b15c1f46747 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5432024-11-14T17:00:28.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c4b5e2a2-dba8-436d-878b-3a8f46ed0a34 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5442024-11-14T17:00:28.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c4b5e2a2-dba8-436d-878b-3a8f46ed0a34 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5452024-11-14T17:00:28.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c4b5e2a2-dba8-436d-878b-3a8f46ed0a34 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5462024-11-14T17:00:29.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 58b90243-c2e2-4b5e-b7be-c8d693aa9534 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5472024-11-14T17:00:29.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 58b90243-c2e2-4b5e-b7be-c8d693aa9534 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5482024-11-14T17:00:29.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 58b90243-c2e2-4b5e-b7be-c8d693aa9534 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5492024-11-14T17:00:30.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 43cd3761-f3e9-4a99-8112-d20d63a534cf roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5502024-11-14T17:00:30.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 43cd3761-f3e9-4a99-8112-d20d63a534cf resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5512024-11-14T17:00:30.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 43cd3761-f3e9-4a99-8112-d20d63a534cf response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5522024-11-14T17:00:31.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 61eb8c72-dba1-466c-ba11-f2b1db38aca6 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5532024-11-14T17:00:31.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 61eb8c72-dba1-466c-ba11-f2b1db38aca6 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5542024-11-14T17:00:31.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 61eb8c72-dba1-466c-ba11-f2b1db38aca6 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5552024-11-14T17:00:32.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f32a6f2a-3331-49d5-9719-23105c5e056a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5562024-11-14T17:00:32.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f32a6f2a-3331-49d5-9719-23105c5e056a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5572024-11-14T17:00:32.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f32a6f2a-3331-49d5-9719-23105c5e056a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5582024-11-14T17:00:33.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = aa1ae087-449f-4ccc-b5fd-2e9bc779d8c3 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5592024-11-14T17:00:33.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = aa1ae087-449f-4ccc-b5fd-2e9bc779d8c3 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5602024-11-14T17:00:33.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = aa1ae087-449f-4ccc-b5fd-2e9bc779d8c3 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5612024-11-14T17:00:34.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9f77f70e-183a-4697-a642-6ab97e1493b9 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5622024-11-14T17:00:34.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9f77f70e-183a-4697-a642-6ab97e1493b9 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5632024-11-14T17:00:34.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1735 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9f77f70e-183a-4697-a642-6ab97e1493b9 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5642024-11-14T17:00:35.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cc411fc8-4a94-4e81-a448-d3e30c31ef10 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5652024-11-14T17:00:35.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cc411fc8-4a94-4e81-a448-d3e30c31ef10 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5662024-11-14T17:00:35.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cc411fc8-4a94-4e81-a448-d3e30c31ef10 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5672024-11-14T17:00:36.707ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
5682024-11-14T17:00:36.707ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
5692024-11-14T17:00:36.707ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5702024-11-14T17:00:36.707ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5712024-11-14T17:00:36.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5722024-11-14T17:00:36.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5732024-11-14T17:00:36.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5742024-11-14T17:00:36.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5752024-11-14T17:00:36.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5762024-11-14T17:00:36.711ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.101562ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5772024-11-14T17:00:36.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5782024-11-14T17:00:36.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5792024-11-14T17:00:36.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5802024-11-14T17:00:36.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5812024-11-14T17:00:36.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5822024-11-14T17:00:36.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5832024-11-14T17:00:36.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
5842024-11-14T17:00:36.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5852024-11-14T17:00:36.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5862024-11-14T17:00:36.728ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
5872024-11-14T17:00:36.728ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.130787ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
5882024-11-14T17:00:37.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7033b4c7-ef43-4e5c-98de-421a3ab076e4 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5892024-11-14T17:00:37.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7033b4c7-ef43-4e5c-98de-421a3ab076e4 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5902024-11-14T17:00:37.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7033b4c7-ef43-4e5c-98de-421a3ab076e4 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5912024-11-14T17:00:38.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a37fe911-03c1-4782-b222-2489fda12dc0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5922024-11-14T17:00:38.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a37fe911-03c1-4782-b222-2489fda12dc0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5932024-11-14T17:00:38.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a37fe911-03c1-4782-b222-2489fda12dc0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5942024-11-14T17:00:39.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1322a469-0dd8-4569-9e2d-8c5eef46dfff roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5952024-11-14T17:00:39.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1322a469-0dd8-4569-9e2d-8c5eef46dfff resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5962024-11-14T17:00:39.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1322a469-0dd8-4569-9e2d-8c5eef46dfff response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5972024-11-14T17:00:40.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0dfbb2f2-1465-475e-abc6-cc04449bfa2a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5982024-11-14T17:00:40.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0dfbb2f2-1465-475e-abc6-cc04449bfa2a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
5992024-11-14T17:00:40.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0dfbb2f2-1465-475e-abc6-cc04449bfa2a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6002024-11-14T17:00:41.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0570f02a-f70b-4833-8262-33de5e4ad955 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6012024-11-14T17:00:41.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0570f02a-f70b-4833-8262-33de5e4ad955 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6022024-11-14T17:00:41.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0570f02a-f70b-4833-8262-33de5e4ad955 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6032024-11-14T17:00:41.604ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1545 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 420cfaaa-604b-40c4-ba5b-4abdae94ec1e response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
6042024-11-14T17:00:42.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8027c178-19d0-4992-a9f1-fa17395a3631 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6052024-11-14T17:00:42.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8027c178-19d0-4992-a9f1-fa17395a3631 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6062024-11-14T17:00:42.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8027c178-19d0-4992-a9f1-fa17395a3631 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6072024-11-14T17:00:43.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 10c46fb2-b741-4094-9146-edf628107933 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6082024-11-14T17:00:43.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 10c46fb2-b741-4094-9146-edf628107933 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6092024-11-14T17:00:43.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 10c46fb2-b741-4094-9146-edf628107933 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6102024-11-14T17:00:44.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4de9a818-1084-4ebe-b0e2-4193d9aad5d8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6112024-11-14T17:00:44.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4de9a818-1084-4ebe-b0e2-4193d9aad5d8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6122024-11-14T17:00:44.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4de9a818-1084-4ebe-b0e2-4193d9aad5d8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6132024-11-14T17:00:45.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 76b8b536-988c-4ae7-8a0a-960b7e874671 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6142024-11-14T17:00:45.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 76b8b536-988c-4ae7-8a0a-960b7e874671 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6152024-11-14T17:00:45.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 76b8b536-988c-4ae7-8a0a-960b7e874671 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6162024-11-14T17:00:46.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 763dc050-9b61-426c-8249-9b00f8178659 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6172024-11-14T17:00:46.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 763dc050-9b61-426c-8249-9b00f8178659 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6182024-11-14T17:00:46.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 763dc050-9b61-426c-8249-9b00f8178659 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
6192024-11-14T17:00:46.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62673 req_id = 7f54a687-db46-4a95-8c8a-8870d64bf2d1 roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
6202024-11-14T17:00:46.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62673 req_id = 7f54a687-db46-4a95-8c8a-8870d64bf2d1 resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
6212024-11-14T17:00:46.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2927 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62673 req_id = 7f54a687-db46-4a95-8c8a-8870d64bf2d1 response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
6222024-11-14T17:00:46.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62673 req_id = 53b2f854-c773-4b63-b14b-5f65d86c79ab roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
6232024-11-14T17:00:46.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62673 req_id = 53b2f854-c773-4b63-b14b-5f65d86c79ab resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
6242024-11-14T17:00:46.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62673 req_id = 53b2f854-c773-4b63-b14b-5f65d86c79ab response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
6252024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
6262024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
6272024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6282024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6292024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
6302024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6312024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
6322024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
6332024-11-14T17:00:46.708ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6342024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6352024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6362024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
6372024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6382024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
6392024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6402024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6412024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
6422024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6432024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
6442024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
6452024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6462024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
6472024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6482024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
6492024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
6502024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6512024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6522024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6532024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6542024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6552024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6562024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6572024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6582024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6592024-11-14T17:00:46.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6602024-11-14T17:00:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6612024-11-14T17:00:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6622024-11-14T17:00:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6632024-11-14T17:00:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6642024-11-14T17:00:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
6652024-11-14T17:00:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
6662024-11-14T17:00:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
6672024-11-14T17:00:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6682024-11-14T17:00:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
6692024-11-14T17:00:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
6702024-11-14T17:00:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
6712024-11-14T17:00:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6722024-11-14T17:00:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
6732024-11-14T17:00:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
6742024-11-14T17:00:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6752024-11-14T17:00:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6762024-11-14T17:00:46.710ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.569869ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6772024-11-14T17:00:46.711ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6782024-11-14T17:00:46.711ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2170, tv_nsec: 441782502 } })
6792024-11-14T17:00:46.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6802024-11-14T17:00:46.711ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
6812024-11-14T17:00:46.711ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6822024-11-14T17:00:46.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6832024-11-14T17:00:46.712ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6842024-11-14T17:00:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6852024-11-14T17:00:46.715ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6862024-11-14T17:00:46.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6872024-11-14T17:00:46.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6882024-11-14T17:00:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6892024-11-14T17:00:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6902024-11-14T17:00:46.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6912024-11-14T17:00:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6922024-11-14T17:00:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6932024-11-14T17:00:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6942024-11-14T17:00:46.715ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6952024-11-14T17:00:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6962024-11-14T17:00:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6972024-11-14T17:00:46.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6982024-11-14T17:00:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6992024-11-14T17:00:46.718ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2170, tv_nsec: 448718349 } })
7002024-11-14T17:00:46.718ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
7012024-11-14T17:00:46.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7022024-11-14T17:00:46.718ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7032024-11-14T17:00:46.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7042024-11-14T17:00:46.719ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7052024-11-14T17:00:46.719ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7062024-11-14T17:00:46.719ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7072024-11-14T17:00:46.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7082024-11-14T17:00:46.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7092024-11-14T17:00:46.720ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7102024-11-14T17:00:46.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7112024-11-14T17:00:46.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7122024-11-14T17:00:46.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7132024-11-14T17:00:46.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7142024-11-14T17:00:46.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7152024-11-14T17:00:46.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7162024-11-14T17:00:46.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7172024-11-14T17:00:46.727ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2170, tv_nsec: 457565578 } })
7182024-11-14T17:00:46.727ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7192024-11-14T17:00:46.727ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
7202024-11-14T17:00:46.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7212024-11-14T17:00:46.730ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7222024-11-14T17:00:46.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7232024-11-14T17:00:46.770ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7242024-11-14T17:00:46.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7252024-11-14T17:00:46.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.203053ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
7262024-11-14T17:00:46.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7272024-11-14T17:00:46.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7282024-11-14T17:00:46.775ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7292024-11-14T17:00:46.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7302024-11-14T17:00:46.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 66.719325ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7312024-11-14T17:00:46.778ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7322024-11-14T17:00:46.778ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7332024-11-14T17:00:46.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7342024-11-14T17:00:46.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.747526ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7352024-11-14T17:00:46.779ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7362024-11-14T17:00:46.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7372024-11-14T17:00:46.780ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7382024-11-14T17:00:46.780ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7392024-11-14T17:00:46.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7402024-11-14T17:00:46.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7412024-11-14T17:00:46.781ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.404464ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
7422024-11-14T17:00:46.782ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7432024-11-14T17:00:46.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7442024-11-14T17:00:46.783ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7452024-11-14T17:00:46.783ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.981712ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7462024-11-14T17:00:46.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7472024-11-14T17:00:46.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7482024-11-14T17:00:46.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
7492024-11-14T17:00:46.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7502024-11-14T17:00:46.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7512024-11-14T17:00:46.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 76.141098ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
7522024-11-14T17:00:46.787ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7532024-11-14T17:00:46.787ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 78.946071ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7542024-11-14T17:00:46.787ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7552024-11-14T17:00:46.787ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7562024-11-14T17:00:46.787ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7572024-11-14T17:00:46.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
7582024-11-14T17:00:46.787ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7592024-11-14T17:00:46.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7602024-11-14T17:00:46.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7612024-11-14T17:00:46.790ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 81.703374ms iteration = 14 status = 0
7622024-11-14T17:00:46.797ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
7632024-11-14T17:00:46.797ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.248404ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
7642024-11-14T17:00:46.816ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7652024-11-14T17:00:46.816ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7662024-11-14T17:00:46.816ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.143129ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7672024-11-14T17:00:46.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7682024-11-14T17:00:46.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7692024-11-14T17:00:46.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7702024-11-14T17:00:46.824ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7712024-11-14T17:00:46.824ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7722024-11-14T17:00:46.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7732024-11-14T17:00:46.826ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7742024-11-14T17:00:46.828ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7752024-11-14T17:00:46.828ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7762024-11-14T17:00:46.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7772024-11-14T17:00:46.829ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
7782024-11-14T17:00:46.829ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7792024-11-14T17:00:46.829ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1321f0fd-7a50-41b2-ab5a-cc18f9fc049a", "content-length": "26", "date": "Thu, 14 Nov 2024 17:00:46 GMT"} })
7802024-11-14T17:00:46.829ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7812024-11-14T17:00:46.830ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
7822024-11-14T17:00:46.882ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 174.329974ms iteration = 17 status = {"physical_disks_added":0}
7832024-11-14T17:00:46.922ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
7842024-11-14T17:00:46.922ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7852024-11-14T17:00:46.922ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "67c2bccf-1896-4a6b-ac33-ca492736f255", "content-length": "26", "date": "Thu, 14 Nov 2024 17:00:46 GMT"} })
7862024-11-14T17:00:46.922ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7872024-11-14T17:00:46.925ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7882024-11-14T17:00:46.956ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
7892024-11-14T17:00:46.956ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7902024-11-14T17:00:46.957ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "59692a2e-389a-4dd0-995e-cf488cb73c8f", "content-length": "26", "date": "Thu, 14 Nov 2024 17:00:46 GMT"} })
7912024-11-14T17:00:46.957ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7922024-11-14T17:00:46.958ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7932024-11-14T17:00:47.028ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7942024-11-14T17:00:47.028ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7952024-11-14T17:00:47.028ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "adcc7a57-6a47-4f13-b3b6-8494f573155a", "content-length": "372", "date": "Thu, 14 Nov 2024 17:00:46 GMT"} })
7962024-11-14T17:00:47.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7972024-11-14T17:00:47.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7982024-11-14T17:00:47.044ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
7992024-11-14T17:00:47.044ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8002024-11-14T17:00:47.044ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7c1ec33b-ed10-4835-9ae5-d0885c8e1afe", "date": "Thu, 14 Nov 2024 17:00:46 GMT"} })
8012024-11-14T17:00:47.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8022024-11-14T17:00:47.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8032024-11-14T17:00:47.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8042024-11-14T17:00:47.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8052024-11-14T17:00:47.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8062024-11-14T17:00:47.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8072024-11-14T17:00:47.053ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8082024-11-14T17:00:47.053ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8092024-11-14T17:00:47.053ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "40025832-9be8-4744-8d66-5741ffa042ef", "date": "Thu, 14 Nov 2024 17:00:46 GMT"} })
8102024-11-14T17:00:47.056ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 347.716516ms iteration = 15 status = {}
8112024-11-14T17:00:47.075ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8122024-11-14T17:00:47.075ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb08cf54-ae01-4131-a077-bc857cafca54", "content-length": "691", "date": "Thu, 14 Nov 2024 17:00:46 GMT"} })
8132024-11-14T17:00:47.075ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
8142024-11-14T17:00:47.075ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
8152024-11-14T17:00:47.075ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
8162024-11-14T17:00:47.076ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 368.535285ms iteration = 14 status = {}
8172024-11-14T17:00:47.085ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 377.243151ms iteration = 14 status = {}
8182024-11-14T17:00:47.118ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
8192024-11-14T17:00:47.118ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3088ae56-a28d-4d2b-b845-1ed9371bf53d", "content-length": "1", "date": "Thu, 14 Nov 2024 17:00:46 GMT"} })
8202024-11-14T17:00:47.120ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8212024-11-14T17:00:47.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8222024-11-14T17:00:47.122ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 414.123074ms iteration = 14 status = null
8232024-11-14T17:00:47.161ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8242024-11-14T17:00:47.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8252024-11-14T17:00:47.164ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
8262024-11-14T17:00:47.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8272024-11-14T17:00:47.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8282024-11-14T17:00:47.173ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8292024-11-14T17:00:47.174ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "feba7e03-6793-4445-a459-585bedff47a3", "content-length": "134", "date": "Thu, 14 Nov 2024 17:00:46 GMT"} })
8302024-11-14T17:00:47.174ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8312024-11-14T17:00:47.174ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
8322024-11-14T17:00:47.174ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8332024-11-14T17:00:47.174ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8342024-11-14T17:00:47.174ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8352024-11-14T17:00:47.174ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8362024-11-14T17:00:47.174ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8372024-11-14T17:00:47.174ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8382024-11-14T17:00:47.174ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8392024-11-14T17:00:47.174ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8402024-11-14T17:00:47.174ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
8412024-11-14T17:00:47.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8422024-11-14T17:00:47.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8432024-11-14T17:00:47.176ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8442024-11-14T17:00:47.177ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "905bcfca-162c-4997-a0d3-0b6632adbd48", "content-length": "2", "date": "Thu, 14 Nov 2024 17:00:46 GMT"} })
8452024-11-14T17:00:47.177ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8462024-11-14T17:00:47.177ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9955e01b-f485-4441-81fc-ef3b19c082c8", "content-length": "52", "date": "Thu, 14 Nov 2024 17:00:46 GMT"} })
8472024-11-14T17:00:47.177ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
8482024-11-14T17:00:47.177ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8492024-11-14T17:00:47.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0760bbf7-b38a-45cc-a782-7a3ac7ba70d0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8502024-11-14T17:00:47.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0760bbf7-b38a-45cc-a782-7a3ac7ba70d0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8512024-11-14T17:00:47.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0760bbf7-b38a-45cc-a782-7a3ac7ba70d0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8522024-11-14T17:00:47.312ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6eb22d95-da83-46da-b22a-aefd85dcf691", "date": "Thu, 14 Nov 2024 17:00:47 GMT"} })
8532024-11-14T17:00:47.312ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
8542024-11-14T17:00:47.312ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8552024-11-14T17:00:47.316ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d649abb8-0673-4433-b662-1dcc5793e11d", "content-length": "682", "date": "Thu, 14 Nov 2024 17:00:47 GMT"} })
8562024-11-14T17:00:47.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8572024-11-14T17:00:47.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8582024-11-14T17:00:47.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8592024-11-14T17:00:47.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8602024-11-14T17:00:47.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8612024-11-14T17:00:47.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8622024-11-14T17:00:47.326ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8632024-11-14T17:00:47.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8642024-11-14T17:00:47.333ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 624.826888ms iteration = 14 status = {}
8652024-11-14T17:00:47.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = cc30534a-58c0-4961-815e-657b701740d1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8662024-11-14T17:00:47.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = cc30534a-58c0-4961-815e-657b701740d1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8672024-11-14T17:00:47.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = cc30534a-58c0-4961-815e-657b701740d1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8682024-11-14T17:00:48.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b06f788f-6cdc-44d2-b579-4a8c47c8d406 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8692024-11-14T17:00:48.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b06f788f-6cdc-44d2-b579-4a8c47c8d406 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8702024-11-14T17:00:48.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b06f788f-6cdc-44d2-b579-4a8c47c8d406 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8712024-11-14T17:00:49.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fbc7a9a1-3d1f-407e-90be-973bbab03359 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8722024-11-14T17:00:49.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fbc7a9a1-3d1f-407e-90be-973bbab03359 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8732024-11-14T17:00:49.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fbc7a9a1-3d1f-407e-90be-973bbab03359 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8742024-11-14T17:00:50.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7f0eb347-9cb3-4f83-8ea7-698b69637a66 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8752024-11-14T17:00:50.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7f0eb347-9cb3-4f83-8ea7-698b69637a66 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8762024-11-14T17:00:50.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7f0eb347-9cb3-4f83-8ea7-698b69637a66 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8772024-11-14T17:00:51.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 60ee3e4f-b0e4-4d3c-9ff9-bbef6ee1573a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8782024-11-14T17:00:51.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 60ee3e4f-b0e4-4d3c-9ff9-bbef6ee1573a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8792024-11-14T17:00:51.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 60ee3e4f-b0e4-4d3c-9ff9-bbef6ee1573a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8802024-11-14T17:00:52.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 26df2836-fc3b-4f88-abb3-78c303dfa1b7 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8812024-11-14T17:00:52.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 26df2836-fc3b-4f88-abb3-78c303dfa1b7 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8822024-11-14T17:00:52.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 26df2836-fc3b-4f88-abb3-78c303dfa1b7 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8832024-11-14T17:00:53.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 71c29529-901d-4321-8f72-94ae7ddb4860 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8842024-11-14T17:00:53.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 71c29529-901d-4321-8f72-94ae7ddb4860 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8852024-11-14T17:00:53.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 71c29529-901d-4321-8f72-94ae7ddb4860 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8862024-11-14T17:00:54.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3e2ccbef-6b3b-4413-9871-4d90a5f4d428 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8872024-11-14T17:00:54.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3e2ccbef-6b3b-4413-9871-4d90a5f4d428 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8882024-11-14T17:00:54.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3e2ccbef-6b3b-4413-9871-4d90a5f4d428 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8892024-11-14T17:00:55.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8b427314-825a-4c80-9055-9381d7c95718 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8902024-11-14T17:00:55.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8b427314-825a-4c80-9055-9381d7c95718 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8912024-11-14T17:00:55.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8b427314-825a-4c80-9055-9381d7c95718 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8922024-11-14T17:00:56.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 13dafffe-ac1f-44e6-8f31-61729eebd216 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8932024-11-14T17:00:56.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 13dafffe-ac1f-44e6-8f31-61729eebd216 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8942024-11-14T17:00:56.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 13dafffe-ac1f-44e6-8f31-61729eebd216 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
8952024-11-14T17:00:56.604ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1314 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 43353607-d972-455a-b76c-bde41315736e response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
8962024-11-14T17:00:56.707ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
8972024-11-14T17:00:56.707ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
8982024-11-14T17:00:56.707ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8992024-11-14T17:00:56.707ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9002024-11-14T17:00:56.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9012024-11-14T17:00:56.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9022024-11-14T17:00:56.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9032024-11-14T17:00:56.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9042024-11-14T17:00:56.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9052024-11-14T17:00:56.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9062024-11-14T17:00:56.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9072024-11-14T17:00:56.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9082024-11-14T17:00:56.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9092024-11-14T17:00:56.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
9102024-11-14T17:00:56.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9112024-11-14T17:00:56.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9122024-11-14T17:00:56.731ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
9132024-11-14T17:00:56.731ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.361827ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
9142024-11-14T17:00:56.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9152024-11-14T17:00:56.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9162024-11-14T17:00:56.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.665429ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9172024-11-14T17:00:57.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 932442a3-d2d3-4bf0-aa90-b8ce1825c1f7 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9182024-11-14T17:00:57.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 932442a3-d2d3-4bf0-aa90-b8ce1825c1f7 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9192024-11-14T17:00:57.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 932442a3-d2d3-4bf0-aa90-b8ce1825c1f7 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9202024-11-14T17:00:58.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9d74a7c4-64a3-48ed-ba4a-9eba6dbba569 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9212024-11-14T17:00:58.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9d74a7c4-64a3-48ed-ba4a-9eba6dbba569 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9222024-11-14T17:00:58.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9d74a7c4-64a3-48ed-ba4a-9eba6dbba569 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9232024-11-14T17:00:59.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e7388e58-df8e-4bd6-8e94-6482fb969ea0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9242024-11-14T17:00:59.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e7388e58-df8e-4bd6-8e94-6482fb969ea0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9252024-11-14T17:00:59.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e7388e58-df8e-4bd6-8e94-6482fb969ea0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9262024-11-14T17:01:00.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f02977ff-aa43-4c52-a577-fee135a5069e roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9272024-11-14T17:01:00.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f02977ff-aa43-4c52-a577-fee135a5069e resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9282024-11-14T17:01:00.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f02977ff-aa43-4c52-a577-fee135a5069e response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9292024-11-14T17:01:01.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2d0658ea-7f3e-45f4-9370-02d0bc96b74a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9302024-11-14T17:01:01.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2d0658ea-7f3e-45f4-9370-02d0bc96b74a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9312024-11-14T17:01:01.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2d0658ea-7f3e-45f4-9370-02d0bc96b74a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9322024-11-14T17:01:02.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 64dd4aed-e064-4f76-b3fd-560ff933b96b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9332024-11-14T17:01:02.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 64dd4aed-e064-4f76-b3fd-560ff933b96b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9342024-11-14T17:01:02.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 64dd4aed-e064-4f76-b3fd-560ff933b96b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9352024-11-14T17:01:03.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 038ccffe-9995-4c19-aa35-720cb4a7dfef roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9362024-11-14T17:01:03.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 038ccffe-9995-4c19-aa35-720cb4a7dfef resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9372024-11-14T17:01:03.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 038ccffe-9995-4c19-aa35-720cb4a7dfef response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9382024-11-14T17:01:04.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bab1aadc-a950-43a9-b481-37f51bd0a5fe roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9392024-11-14T17:01:04.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bab1aadc-a950-43a9-b481-37f51bd0a5fe resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9402024-11-14T17:01:04.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bab1aadc-a950-43a9-b481-37f51bd0a5fe response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9412024-11-14T17:01:05.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f1dcef62-57dd-42c8-bebd-7d2635f23146 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9422024-11-14T17:01:05.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f1dcef62-57dd-42c8-bebd-7d2635f23146 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9432024-11-14T17:01:05.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f1dcef62-57dd-42c8-bebd-7d2635f23146 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9442024-11-14T17:01:06.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 564a1704-d289-4f1d-9bee-41a8795c6341 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9452024-11-14T17:01:06.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 564a1704-d289-4f1d-9bee-41a8795c6341 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9462024-11-14T17:01:06.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 564a1704-d289-4f1d-9bee-41a8795c6341 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9472024-11-14T17:01:06.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
9482024-11-14T17:01:06.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9492024-11-14T17:01:06.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
9502024-11-14T17:01:06.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9512024-11-14T17:01:06.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9522024-11-14T17:01:06.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9532024-11-14T17:01:06.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9542024-11-14T17:01:06.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9552024-11-14T17:01:06.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9562024-11-14T17:01:06.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9572024-11-14T17:01:06.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9582024-11-14T17:01:06.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9592024-11-14T17:01:06.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9602024-11-14T17:01:06.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9612024-11-14T17:01:06.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9622024-11-14T17:01:06.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
9632024-11-14T17:01:06.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9642024-11-14T17:01:06.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9652024-11-14T17:01:06.730ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
9662024-11-14T17:01:06.731ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.365294ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
9672024-11-14T17:01:06.742ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.579498ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9682024-11-14T17:01:07.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4ee9f9c0-0766-4af1-ae2f-0b751a3b98fb roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9692024-11-14T17:01:07.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4ee9f9c0-0766-4af1-ae2f-0b751a3b98fb resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9702024-11-14T17:01:07.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4ee9f9c0-0766-4af1-ae2f-0b751a3b98fb response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9712024-11-14T17:01:08.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b3ef8390-0115-4ef3-808d-9a4897714c06 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9722024-11-14T17:01:08.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b3ef8390-0115-4ef3-808d-9a4897714c06 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9732024-11-14T17:01:08.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b3ef8390-0115-4ef3-808d-9a4897714c06 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9742024-11-14T17:01:09.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 05543c7c-f2e6-4524-b95b-b570c5a432fe roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9752024-11-14T17:01:09.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 05543c7c-f2e6-4524-b95b-b570c5a432fe resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9762024-11-14T17:01:09.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 05543c7c-f2e6-4524-b95b-b570c5a432fe response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9772024-11-14T17:01:10.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 010d275c-ed1b-4673-9963-b30b0582298a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9782024-11-14T17:01:10.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 010d275c-ed1b-4673-9963-b30b0582298a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9792024-11-14T17:01:10.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 010d275c-ed1b-4673-9963-b30b0582298a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9802024-11-14T17:01:11.604ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1525 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = fe639f21-ee6e-4db5-8521-0013c7f1f9f9 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
9812024-11-14T17:01:11.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 240f155f-65a5-4b8f-921c-ed7c9865d5b8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9822024-11-14T17:01:11.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 240f155f-65a5-4b8f-921c-ed7c9865d5b8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9832024-11-14T17:01:11.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 240f155f-65a5-4b8f-921c-ed7c9865d5b8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9842024-11-14T17:01:12.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b275d0b2-e2ab-4dc7-a39c-3d7945e71649 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9852024-11-14T17:01:12.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b275d0b2-e2ab-4dc7-a39c-3d7945e71649 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9862024-11-14T17:01:12.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1599 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b275d0b2-e2ab-4dc7-a39c-3d7945e71649 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9872024-11-14T17:01:13.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 21bcabbf-60f1-4f2d-9784-d3e43e974d69 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9882024-11-14T17:01:13.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 21bcabbf-60f1-4f2d-9784-d3e43e974d69 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9892024-11-14T17:01:13.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 21bcabbf-60f1-4f2d-9784-d3e43e974d69 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9902024-11-14T17:01:14.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b8fb72d1-affc-4eb9-a645-5b300c75e1f0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9912024-11-14T17:01:14.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b8fb72d1-affc-4eb9-a645-5b300c75e1f0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9922024-11-14T17:01:14.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b8fb72d1-affc-4eb9-a645-5b300c75e1f0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9932024-11-14T17:01:15.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a8981ad1-7ba0-4c9e-956c-a7256b4d6a2b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9942024-11-14T17:01:15.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a8981ad1-7ba0-4c9e-956c-a7256b4d6a2b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9952024-11-14T17:01:15.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a8981ad1-7ba0-4c9e-956c-a7256b4d6a2b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
9962024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
9972024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
9982024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
9992024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
10002024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10012024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
10022024-11-14T17:01:16.708ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10032024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10042024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
10052024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10062024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10072024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
10082024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10092024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
10102024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
10112024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
10122024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10132024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
10142024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
10152024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10162024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
10172024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
10182024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10192024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10202024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
10212024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
10222024-11-14T17:01:16.708ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10232024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
10242024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
10252024-11-14T17:01:16.709ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5
10262024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.921\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5"}
10272024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
10282024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
10292024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
10302024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10312024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
10322024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10332024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10342024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
10352024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10362024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
10372024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
10382024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
10392024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10402024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
10412024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10422024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
10432024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10442024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
10452024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
10462024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10472024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10482024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
10492024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10502024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10512024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
10522024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10532024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10542024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
10552024-11-14T17:01:16.709ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 16:51:16.709327703 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
10562024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
10572024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10582024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10592024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
10602024-11-14T17:01:16.709ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
10612024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
10622024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10632024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10642024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10652024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10662024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10672024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
10682024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10692024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10702024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
10712024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10722024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
10732024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10742024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10752024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10762024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10772024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
10782024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10792024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10802024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10812024-11-14T17:01:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10822024-11-14T17:01:16.709ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94482e71-9503-4d09-b73f-615fbf343a2e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2200, tv_nsec: 440244829 } })
10832024-11-14T17:01:16.709ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89b01be2-c37f-445d-addd-6b4be9cd73c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc5fdca1-6d92-4ff4-b5ae-2f44553a2186.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2200, tv_nsec: 440324440 } })
10842024-11-14T17:01:16.710ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
10852024-11-14T17:01:16.710ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.389911ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
10862024-11-14T17:01:16.710ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
10872024-11-14T17:01:16.710ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.160116ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
10882024-11-14T17:01:16.712ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10892024-11-14T17:01:16.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10902024-11-14T17:01:16.712ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10912024-11-14T17:01:16.713ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.128263ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10922024-11-14T17:01:16.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10932024-11-14T17:01:16.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10942024-11-14T17:01:16.715ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10952024-11-14T17:01:16.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10962024-11-14T17:01:16.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
10972024-11-14T17:01:16.715ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10982024-11-14T17:01:16.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10992024-11-14T17:01:16.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11002024-11-14T17:01:16.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11012024-11-14T17:01:16.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11022024-11-14T17:01:16.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11032024-11-14T17:01:16.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11042024-11-14T17:01:16.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11052024-11-14T17:01:16.717ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11062024-11-14T17:01:16.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11072024-11-14T17:01:16.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11082024-11-14T17:01:16.719ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.698892ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
11092024-11-14T17:01:16.719ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11102024-11-14T17:01:16.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11112024-11-14T17:01:16.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11122024-11-14T17:01:16.720ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11132024-11-14T17:01:16.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11142024-11-14T17:01:16.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11152024-11-14T17:01:16.723ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2200, tv_nsec: 453950238 } })
11162024-11-14T17:01:16.723ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
11172024-11-14T17:01:16.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11182024-11-14T17:01:16.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11192024-11-14T17:01:16.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11202024-11-14T17:01:16.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11212024-11-14T17:01:16.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11222024-11-14T17:01:16.729ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 16:51:16.709327703 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
11232024-11-14T17:01:16.729ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.220606ms iteration = 8 status = {"expiration":"2024-11-14T16:51:16.709327703Z","pruned":[]}
11242024-11-14T17:01:16.730ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2200, tv_nsec: 460383733 } })
11252024-11-14T17:01:16.730ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
11262024-11-14T17:01:16.730ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11272024-11-14T17:01:16.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11282024-11-14T17:01:16.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11292024-11-14T17:01:16.732ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11302024-11-14T17:01:16.732ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11312024-11-14T17:01:16.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11322024-11-14T17:01:16.733ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 24.581315ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11332024-11-14T17:01:16.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
11342024-11-14T17:01:16.733ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11352024-11-14T17:01:16.734ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2200, tv_nsec: 464361993 } })
11362024-11-14T17:01:16.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11372024-11-14T17:01:16.734ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
11382024-11-14T17:01:16.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11392024-11-14T17:01:16.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11402024-11-14T17:01:16.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11412024-11-14T17:01:16.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11422024-11-14T17:01:16.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11432024-11-14T17:01:16.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11442024-11-14T17:01:16.751ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11452024-11-14T17:01:16.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11462024-11-14T17:01:16.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11472024-11-14T17:01:16.757ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11482024-11-14T17:01:16.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11492024-11-14T17:01:16.760ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11502024-11-14T17:01:16.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11512024-11-14T17:01:16.770ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.492757ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
11522024-11-14T17:01:16.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.433631ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
11532024-11-14T17:01:16.781ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11542024-11-14T17:01:16.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11552024-11-14T17:01:16.784ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 75.484473ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
11562024-11-14T17:01:16.784ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11572024-11-14T17:01:16.785ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11582024-11-14T17:01:16.785ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11592024-11-14T17:01:16.785ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11602024-11-14T17:01:16.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11612024-11-14T17:01:16.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11622024-11-14T17:01:16.789ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11632024-11-14T17:01:16.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11642024-11-14T17:01:16.790ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11652024-11-14T17:01:16.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11662024-11-14T17:01:16.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11672024-11-14T17:01:16.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11682024-11-14T17:01:16.793ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11692024-11-14T17:01:16.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11702024-11-14T17:01:16.802ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11712024-11-14T17:01:16.803ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 93.888429ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11722024-11-14T17:01:16.804ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
11732024-11-14T17:01:16.804ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
11742024-11-14T17:01:16.804ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 95.154337ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
11752024-11-14T17:01:16.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11762024-11-14T17:01:16.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11772024-11-14T17:01:16.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11782024-11-14T17:01:16.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11792024-11-14T17:01:16.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11802024-11-14T17:01:16.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11812024-11-14T17:01:16.822ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
11822024-11-14T17:01:16.822ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
11832024-11-14T17:01:16.822ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 113.0435ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
11842024-11-14T17:01:16.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11852024-11-14T17:01:16.827ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
11862024-11-14T17:01:16.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
11872024-11-14T17:01:16.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11882024-11-14T17:01:16.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11892024-11-14T17:01:16.830ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
11902024-11-14T17:01:16.830ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
11912024-11-14T17:01:16.830ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
11922024-11-14T17:01:16.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11932024-11-14T17:01:16.830ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11942024-11-14T17:01:16.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11952024-11-14T17:01:16.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11962024-11-14T17:01:16.831ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 122.619696ms iteration = 15 status = 0
11972024-11-14T17:01:16.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
11982024-11-14T17:01:16.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11992024-11-14T17:01:16.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
12002024-11-14T17:01:16.835ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12012024-11-14T17:01:16.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12022024-11-14T17:01:16.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12032024-11-14T17:01:16.836ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 127.310793ms iteration = 18 status = {"physical_disks_added":0}
12042024-11-14T17:01:16.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12052024-11-14T17:01:16.842ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12062024-11-14T17:01:16.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12072024-11-14T17:01:16.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12082024-11-14T17:01:16.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12092024-11-14T17:01:16.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12102024-11-14T17:01:16.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 142.351592ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
12112024-11-14T17:01:16.852ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12122024-11-14T17:01:16.852ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12132024-11-14T17:01:16.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12142024-11-14T17:01:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12152024-11-14T17:01:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 143.945058ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12162024-11-14T17:01:16.854ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
12172024-11-14T17:01:16.854ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 145.604805ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
12182024-11-14T17:01:16.869ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
12192024-11-14T17:01:16.869ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
12202024-11-14T17:01:16.869ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
12212024-11-14T17:01:16.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12222024-11-14T17:01:16.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12232024-11-14T17:01:16.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12242024-11-14T17:01:16.874ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
12252024-11-14T17:01:16.874ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12262024-11-14T17:01:16.874ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a9c4eb3-7a34-47ec-a734-115a025774af", "content-length": "26", "date": "Thu, 14 Nov 2024 17:01:16 GMT"} })
12272024-11-14T17:01:16.874ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12282024-11-14T17:01:16.877ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
12292024-11-14T17:01:16.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12302024-11-14T17:01:16.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12312024-11-14T17:01:16.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12322024-11-14T17:01:16.883ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
12332024-11-14T17:01:16.883ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
12342024-11-14T17:01:16.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12352024-11-14T17:01:16.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12362024-11-14T17:01:16.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12372024-11-14T17:01:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12382024-11-14T17:01:16.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12392024-11-14T17:01:16.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12402024-11-14T17:01:16.905ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
12412024-11-14T17:01:16.905ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12422024-11-14T17:01:16.905ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d87d842-b4af-4fb2-8799-bd1d79adab9e", "content-length": "26", "date": "Thu, 14 Nov 2024 17:01:16 GMT"} })
12432024-11-14T17:01:16.905ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12442024-11-14T17:01:16.908ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12452024-11-14T17:01:16.911ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12462024-11-14T17:01:16.911ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12472024-11-14T17:01:16.911ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 200.599386ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12482024-11-14T17:01:16.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fb558b1b-bf51-4301-a29e-842a8234501f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
12492024-11-14T17:01:16.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fb558b1b-bf51-4301-a29e-842a8234501f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
12502024-11-14T17:01:16.924ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12512024-11-14T17:01:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12522024-11-14T17:01:16.925ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
12532024-11-14T17:01:16.925ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 0 version = 2
12542024-11-14T17:01:16.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12552024-11-14T17:01:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12562024-11-14T17:01:16.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12572024-11-14T17:01:16.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12582024-11-14T17:01:16.988ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
12592024-11-14T17:01:17.011ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
12602024-11-14T17:01:17.011ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12612024-11-14T17:01:17.012ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "33761498-cec2-4be4-bb11-a294dba8459c", "content-length": "26", "date": "Thu, 14 Nov 2024 17:01:16 GMT"} })
12622024-11-14T17:01:17.012ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12632024-11-14T17:01:17.015ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12642024-11-14T17:01:17.037ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
12652024-11-14T17:01:17.037ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 328.647155ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
12662024-11-14T17:01:17.071ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
12672024-11-14T17:01:17.095ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12682024-11-14T17:01:17.095ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12692024-11-14T17:01:17.095ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8216dc83-7aaf-46db-aa0e-9327dbac0891", "content-length": "372", "date": "Thu, 14 Nov 2024 17:01:17 GMT"} })
12702024-11-14T17:01:17.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12712024-11-14T17:01:17.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12722024-11-14T17:01:17.098ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
12732024-11-14T17:01:17.098ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
12742024-11-14T17:01:17.098ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 16:54:46.198050 UTC dns_group = internal generation = 1
12752024-11-14T17:01:17.098ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 389.486368ms iteration = 9 status = {"generation":1}
12762024-11-14T17:01:17.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fb558b1b-bf51-4301-a29e-842a8234501f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
12772024-11-14T17:01:17.098ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12782024-11-14T17:01:17.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12792024-11-14T17:01:17.101ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12802024-11-14T17:01:17.101ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12812024-11-14T17:01:17.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12822024-11-14T17:01:17.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12832024-11-14T17:01:17.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12842024-11-14T17:01:17.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12852024-11-14T17:01:17.107ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 1 version = 2
12862024-11-14T17:01:17.107ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
12872024-11-14T17:01:17.107ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 16:54:47.468912 UTC dns_group = external generation = 2
12882024-11-14T17:01:17.107ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 398.448ms iteration = 9 status = {"generation":2}
12892024-11-14T17:01:17.109ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12902024-11-14T17:01:17.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12912024-11-14T17:01:17.112ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12922024-11-14T17:01:17.114ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12932024-11-14T17:01:17.114ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12942024-11-14T17:01:17.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12952024-11-14T17:01:17.116ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12962024-11-14T17:01:17.119ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12972024-11-14T17:01:17.119ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12982024-11-14T17:01:17.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12992024-11-14T17:01:17.143ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 434.564474ms iteration = 15 status = {}
13002024-11-14T17:01:17.149ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T16:54:14.392760Z, time_modified: 2024-11-14T16:54:14.392760Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }) }
13012024-11-14T17:01:17.149ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 440.651062ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]}},"default_endpoint":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
13022024-11-14T17:01:17.157ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
13032024-11-14T17:01:17.157ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
13042024-11-14T17:01:17.158ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "10c2c26c-efa8-4d91-a988-2f8e4f197540", "date": "Thu, 14 Nov 2024 17:01:17 GMT"} })
13052024-11-14T17:01:17.158ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13062024-11-14T17:01:17.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13072024-11-14T17:01:17.161ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13082024-11-14T17:01:17.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13092024-11-14T17:01:17.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13102024-11-14T17:01:17.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13112024-11-14T17:01:17.169ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
13122024-11-14T17:01:17.170ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "831d91dd-2478-4872-ad75-6f4fda5fe6ed", "date": "Thu, 14 Nov 2024 17:01:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13132024-11-14T17:01:17.170ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13142024-11-14T17:01:17.170ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
13152024-11-14T17:01:17.170ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13162024-11-14T17:01:17.170ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d30ec779-156c-4927-ac28-d5deadc9bf3c", "date": "Thu, 14 Nov 2024 17:01:17 GMT"} })
13172024-11-14T17:01:17.172ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8f92cd48-c467-4cdf-b806-db92e3741b3a", "date": "Thu, 14 Nov 2024 17:01:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13182024-11-14T17:01:17.172ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13192024-11-14T17:01:17.173ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 464.92043ms iteration = 16 status = {}
13202024-11-14T17:01:17.175ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13212024-11-14T17:01:17.175ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 466.513686ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
13222024-11-14T17:01:17.195ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13232024-11-14T17:01:17.195ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "34076b5a-da0b-460e-9141-908f6b4412f4", "content-length": "1", "date": "Thu, 14 Nov 2024 17:01:16 GMT"} })
13242024-11-14T17:01:17.197ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
13252024-11-14T17:01:17.198ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13262024-11-14T17:01:17.198ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "73ff2556-bb15-4267-b627-0ba8b4864aea", "date": "Thu, 14 Nov 2024 17:01:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
13272024-11-14T17:01:17.198ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
13282024-11-14T17:01:17.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13292024-11-14T17:01:17.200ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7bff5b58-acc0-49a7-8e55-5a1c8d786306", "date": "Thu, 14 Nov 2024 17:01:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
13302024-11-14T17:01:17.200ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
13312024-11-14T17:01:17.200ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 491.375816ms iteration = 15 status = null
13322024-11-14T17:01:17.202ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "53d11daf-b6f3-4c3f-b2a8-f603da24a522", "date": "Thu, 14 Nov 2024 17:01:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
13332024-11-14T17:01:17.202ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
13342024-11-14T17:01:17.204ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
13352024-11-14T17:01:17.204ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 495.770266ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
13362024-11-14T17:01:17.260ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
13372024-11-14T17:01:17.267ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13382024-11-14T17:01:17.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13392024-11-14T17:01:17.276ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
13402024-11-14T17:01:17.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13412024-11-14T17:01:17.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13422024-11-14T17:01:17.287ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
13432024-11-14T17:01:17.287ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5294dfc7-1e8b-407e-9b7c-3df9de7e5d64", "content-length": "134", "date": "Thu, 14 Nov 2024 17:01:16 GMT"} })
13442024-11-14T17:01:17.287ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
13452024-11-14T17:01:17.287ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
13462024-11-14T17:01:17.288ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
13472024-11-14T17:01:17.288ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
13482024-11-14T17:01:17.288ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13492024-11-14T17:01:17.288ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13502024-11-14T17:01:17.288ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13512024-11-14T17:01:17.288ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13522024-11-14T17:01:17.288ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13532024-11-14T17:01:17.288ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13542024-11-14T17:01:17.288ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
13552024-11-14T17:01:17.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13562024-11-14T17:01:17.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13572024-11-14T17:01:17.291ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
13582024-11-14T17:01:17.291ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce91c23b-1dfc-4e68-9da9-3695c345e095", "content-length": "2", "date": "Thu, 14 Nov 2024 17:01:16 GMT"} })
13592024-11-14T17:01:17.291ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
13602024-11-14T17:01:17.291ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "83a5d33e-16f7-4925-ae8d-fd58bd1345ec", "content-length": "52", "date": "Thu, 14 Nov 2024 17:01:16 GMT"} })
13612024-11-14T17:01:17.291ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
13622024-11-14T17:01:17.291ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
13632024-11-14T17:01:17.357ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc36c433-49f3-4c6e-a401-17e3d3562af0", "content-length": "691", "date": "Thu, 14 Nov 2024 17:01:17 GMT"} })
13642024-11-14T17:01:17.357ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
13652024-11-14T17:01:17.357ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
13662024-11-14T17:01:17.358ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
13672024-11-14T17:01:17.359ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 650.068757ms iteration = 15 status = {}
13682024-11-14T17:01:17.469ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "45fabad6-a826-40d6-84fc-f565e34b0ef1", "date": "Thu, 14 Nov 2024 17:01:17 GMT"} })
13692024-11-14T17:01:17.469ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
13702024-11-14T17:01:17.469ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
13712024-11-14T17:01:17.473ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b59ab76-048a-49bf-8dd4-a2af0acf2bfb", "content-length": "682", "date": "Thu, 14 Nov 2024 17:01:17 GMT"} })
13722024-11-14T17:01:17.473ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13732024-11-14T17:01:17.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13742024-11-14T17:01:17.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13752024-11-14T17:01:17.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13762024-11-14T17:01:17.481ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13772024-11-14T17:01:17.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13782024-11-14T17:01:17.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13792024-11-14T17:01:17.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13802024-11-14T17:01:17.490ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 781.984704ms iteration = 15 status = {}
13812024-11-14T17:01:17.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = c091bc77-45f8-47da-9f62-07d9b5e84447 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
13822024-11-14T17:01:17.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = c091bc77-45f8-47da-9f62-07d9b5e84447 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
13832024-11-14T17:01:17.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2838 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = c091bc77-45f8-47da-9f62-07d9b5e84447 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
13842024-11-14T17:01:18.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bb587849-1c0b-49a1-83f5-18dd3ddaa28b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
13852024-11-14T17:01:18.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bb587849-1c0b-49a1-83f5-18dd3ddaa28b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
13862024-11-14T17:01:18.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bb587849-1c0b-49a1-83f5-18dd3ddaa28b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
13872024-11-14T17:01:19.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 723efa98-3957-47b0-93d3-8e0280ef8bd5 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
13882024-11-14T17:01:19.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 723efa98-3957-47b0-93d3-8e0280ef8bd5 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
13892024-11-14T17:01:19.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 723efa98-3957-47b0-93d3-8e0280ef8bd5 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
13902024-11-14T17:01:20.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f9a4929d-0a17-4954-a4f1-6ba9c0cb8556 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
13912024-11-14T17:01:20.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f9a4929d-0a17-4954-a4f1-6ba9c0cb8556 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
13922024-11-14T17:01:20.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f9a4929d-0a17-4954-a4f1-6ba9c0cb8556 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
13932024-11-14T17:01:21.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d0f6a422-96c6-4f0b-87e1-2576b886fcd9 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
13942024-11-14T17:01:21.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d0f6a422-96c6-4f0b-87e1-2576b886fcd9 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
13952024-11-14T17:01:21.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d0f6a422-96c6-4f0b-87e1-2576b886fcd9 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
13962024-11-14T17:01:22.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5c03e3c2-87f4-4f29-8f2f-a2c9ba34a1c9 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
13972024-11-14T17:01:22.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5c03e3c2-87f4-4f29-8f2f-a2c9ba34a1c9 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
13982024-11-14T17:01:22.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5c03e3c2-87f4-4f29-8f2f-a2c9ba34a1c9 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
13992024-11-14T17:01:23.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bb167fc0-d40e-4f2f-b49f-230c25fa4c75 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14002024-11-14T17:01:23.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bb167fc0-d40e-4f2f-b49f-230c25fa4c75 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14012024-11-14T17:01:23.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bb167fc0-d40e-4f2f-b49f-230c25fa4c75 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14022024-11-14T17:01:24.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4f92b3d3-aeae-433d-b448-86222dddde9a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14032024-11-14T17:01:24.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4f92b3d3-aeae-433d-b448-86222dddde9a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14042024-11-14T17:01:24.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4f92b3d3-aeae-433d-b448-86222dddde9a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14052024-11-14T17:01:25.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e9e7795f-dc48-44c4-b416-7a18cede951f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14062024-11-14T17:01:25.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e9e7795f-dc48-44c4-b416-7a18cede951f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14072024-11-14T17:01:25.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e9e7795f-dc48-44c4-b416-7a18cede951f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14082024-11-14T17:01:26.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 11ec2783-76d1-41e5-b6cd-c6ba466d6424 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14092024-11-14T17:01:26.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 11ec2783-76d1-41e5-b6cd-c6ba466d6424 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14102024-11-14T17:01:26.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 11ec2783-76d1-41e5-b6cd-c6ba466d6424 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14112024-11-14T17:01:26.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1495 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 9666f621-6ed5-4c90-b101-84b14913bb1d response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
14122024-11-14T17:01:26.707ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
14132024-11-14T17:01:26.707ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
14142024-11-14T17:01:26.707ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14152024-11-14T17:01:26.707ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14162024-11-14T17:01:26.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14172024-11-14T17:01:26.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14182024-11-14T17:01:26.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14192024-11-14T17:01:26.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14202024-11-14T17:01:26.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14212024-11-14T17:01:26.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14222024-11-14T17:01:26.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14232024-11-14T17:01:26.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.409949ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14242024-11-14T17:01:26.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14252024-11-14T17:01:26.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14262024-11-14T17:01:26.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14272024-11-14T17:01:26.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14282024-11-14T17:01:26.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
14292024-11-14T17:01:26.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14302024-11-14T17:01:26.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14312024-11-14T17:01:26.731ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
14322024-11-14T17:01:26.731ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.350717ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
14332024-11-14T17:01:27.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ef2f6b26-783d-4afa-8650-17f945f7aa05 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14342024-11-14T17:01:27.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ef2f6b26-783d-4afa-8650-17f945f7aa05 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14352024-11-14T17:01:27.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2558 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ef2f6b26-783d-4afa-8650-17f945f7aa05 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14362024-11-14T17:01:28.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e20f7a91-3daa-4d0c-8cad-3aaabeea3b6c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14372024-11-14T17:01:28.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e20f7a91-3daa-4d0c-8cad-3aaabeea3b6c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14382024-11-14T17:01:28.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1768 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e20f7a91-3daa-4d0c-8cad-3aaabeea3b6c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14392024-11-14T17:01:29.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3bba63bd-1a39-448a-bd12-ca836050c096 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14402024-11-14T17:01:29.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3bba63bd-1a39-448a-bd12-ca836050c096 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14412024-11-14T17:01:29.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3bba63bd-1a39-448a-bd12-ca836050c096 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14422024-11-14T17:01:30.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0a99d717-079b-47a0-bc5b-47f9ed940649 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14432024-11-14T17:01:30.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0a99d717-079b-47a0-bc5b-47f9ed940649 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14442024-11-14T17:01:30.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0a99d717-079b-47a0-bc5b-47f9ed940649 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14452024-11-14T17:01:31.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 575cbf11-6f49-4046-9af9-bcb84b6dcc3f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14462024-11-14T17:01:31.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 575cbf11-6f49-4046-9af9-bcb84b6dcc3f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14472024-11-14T17:01:31.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 575cbf11-6f49-4046-9af9-bcb84b6dcc3f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14482024-11-14T17:01:32.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 82578438-4502-4c2f-b315-a2aff96b8520 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14492024-11-14T17:01:32.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 82578438-4502-4c2f-b315-a2aff96b8520 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14502024-11-14T17:01:32.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 82578438-4502-4c2f-b315-a2aff96b8520 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14512024-11-14T17:01:33.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 303b37e9-a887-4afc-a901-5ffe29247a95 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14522024-11-14T17:01:33.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 303b37e9-a887-4afc-a901-5ffe29247a95 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14532024-11-14T17:01:33.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 303b37e9-a887-4afc-a901-5ffe29247a95 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14542024-11-14T17:01:34.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 330257da-3007-43ea-9b12-052064a976a1 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14552024-11-14T17:01:34.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 330257da-3007-43ea-9b12-052064a976a1 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14562024-11-14T17:01:34.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 330257da-3007-43ea-9b12-052064a976a1 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14572024-11-14T17:01:35.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a5ed414b-5554-4dd5-b69e-72584a2676d8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14582024-11-14T17:01:35.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a5ed414b-5554-4dd5-b69e-72584a2676d8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14592024-11-14T17:01:35.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a5ed414b-5554-4dd5-b69e-72584a2676d8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14602024-11-14T17:01:36.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d64305b4-6994-4632-9ce0-8a66aac3ad6b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14612024-11-14T17:01:36.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d64305b4-6994-4632-9ce0-8a66aac3ad6b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14622024-11-14T17:01:36.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d64305b4-6994-4632-9ce0-8a66aac3ad6b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14632024-11-14T17:01:36.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
14642024-11-14T17:01:36.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
14652024-11-14T17:01:36.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14662024-11-14T17:01:36.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14672024-11-14T17:01:36.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14682024-11-14T17:01:36.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14692024-11-14T17:01:36.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14702024-11-14T17:01:36.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14712024-11-14T17:01:36.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14722024-11-14T17:01:36.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.123103ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14732024-11-14T17:01:36.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14742024-11-14T17:01:36.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14752024-11-14T17:01:36.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14762024-11-14T17:01:36.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14772024-11-14T17:01:36.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14782024-11-14T17:01:36.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14792024-11-14T17:01:36.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
14802024-11-14T17:01:36.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14812024-11-14T17:01:36.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14822024-11-14T17:01:36.727ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
14832024-11-14T17:01:36.727ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.213863ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
14842024-11-14T17:01:37.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cc7f44f9-83c6-4b8b-9a12-0f37294347ca roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14852024-11-14T17:01:37.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cc7f44f9-83c6-4b8b-9a12-0f37294347ca resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14862024-11-14T17:01:37.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1778 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cc7f44f9-83c6-4b8b-9a12-0f37294347ca response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14872024-11-14T17:01:38.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d57abf6c-4e1c-457f-b310-809b5c654634 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14882024-11-14T17:01:38.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d57abf6c-4e1c-457f-b310-809b5c654634 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14892024-11-14T17:01:38.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d57abf6c-4e1c-457f-b310-809b5c654634 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14902024-11-14T17:01:39.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 634f12c6-fa28-4cc7-927d-e5eb437d9e44 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14912024-11-14T17:01:39.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 634f12c6-fa28-4cc7-927d-e5eb437d9e44 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14922024-11-14T17:01:39.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 634f12c6-fa28-4cc7-927d-e5eb437d9e44 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14932024-11-14T17:01:40.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ea3073ca-9271-489c-a7cf-9bf11caef781 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14942024-11-14T17:01:40.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ea3073ca-9271-489c-a7cf-9bf11caef781 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14952024-11-14T17:01:40.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ea3073ca-9271-489c-a7cf-9bf11caef781 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14962024-11-14T17:01:41.604ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1546 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = dd0d8bfd-bfd4-42d1-b864-d263c4b3df0e response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
14972024-11-14T17:01:41.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 28a55001-ca06-45d3-9e08-ec48bcdfa63f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14982024-11-14T17:01:41.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 28a55001-ca06-45d3-9e08-ec48bcdfa63f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
14992024-11-14T17:01:41.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 28a55001-ca06-45d3-9e08-ec48bcdfa63f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
15002024-11-14T17:01:42.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8c4b1a48-3e58-46c5-b85d-4c36b38110e2 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
15012024-11-14T17:01:42.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8c4b1a48-3e58-46c5-b85d-4c36b38110e2 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
15022024-11-14T17:01:42.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8c4b1a48-3e58-46c5-b85d-4c36b38110e2 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
15032024-11-14T17:01:43.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b32f8415-0746-465f-b2db-f60461f2c358 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
15042024-11-14T17:01:43.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b32f8415-0746-465f-b2db-f60461f2c358 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
15052024-11-14T17:01:43.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b32f8415-0746-465f-b2db-f60461f2c358 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
15062024-11-14T17:01:44.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f36f4462-e098-44ee-8773-e45276738c60 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
15072024-11-14T17:01:44.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f36f4462-e098-44ee-8773-e45276738c60 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
15082024-11-14T17:01:44.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f36f4462-e098-44ee-8773-e45276738c60 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
15092024-11-14T17:01:45.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d4dd675b-264c-41eb-85f3-c1a338b544c9 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
15102024-11-14T17:01:45.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d4dd675b-264c-41eb-85f3-c1a338b544c9 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
15112024-11-14T17:01:45.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d4dd675b-264c-41eb-85f3-c1a338b544c9 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
15122024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
15132024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15142024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
15152024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
15162024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
15172024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15182024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
15192024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15202024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
15212024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
15222024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
15232024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
15242024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
15252024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15262024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15272024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15282024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
15292024-11-14T17:01:46.708ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15302024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15312024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
15322024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15332024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
15342024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15352024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
15362024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
15372024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15382024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15392024-11-14T17:01:46.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15402024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15412024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15422024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15432024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15442024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15452024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15462024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15472024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15482024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15492024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15502024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15512024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
15522024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15532024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
15542024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
15552024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
15562024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
15572024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
15582024-11-14T17:01:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15592024-11-14T17:01:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15602024-11-14T17:01:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
15612024-11-14T17:01:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15622024-11-14T17:01:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15632024-11-14T17:01:46.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15642024-11-14T17:01:46.711ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15652024-11-14T17:01:46.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15662024-11-14T17:01:46.711ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15672024-11-14T17:01:46.712ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.779295ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15682024-11-14T17:01:46.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15692024-11-14T17:01:46.714ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15702024-11-14T17:01:46.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15712024-11-14T17:01:46.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15722024-11-14T17:01:46.714ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15732024-11-14T17:01:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15742024-11-14T17:01:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15752024-11-14T17:01:46.715ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15762024-11-14T17:01:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15772024-11-14T17:01:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15782024-11-14T17:01:46.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15792024-11-14T17:01:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15802024-11-14T17:01:46.718ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15812024-11-14T17:01:46.718ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15822024-11-14T17:01:46.718ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2230, tv_nsec: 448565068 } })
15832024-11-14T17:01:46.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15842024-11-14T17:01:46.718ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
15852024-11-14T17:01:46.719ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2230, tv_nsec: 449334086 } })
15862024-11-14T17:01:46.719ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15872024-11-14T17:01:46.719ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15882024-11-14T17:01:46.719ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15892024-11-14T17:01:46.719ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
15902024-11-14T17:01:46.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15912024-11-14T17:01:46.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15922024-11-14T17:01:46.721ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15932024-11-14T17:01:46.721ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15942024-11-14T17:01:46.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15952024-11-14T17:01:46.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15962024-11-14T17:01:46.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15972024-11-14T17:01:46.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15982024-11-14T17:01:46.723ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.085278ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
15992024-11-14T17:01:46.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.871735ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
16002024-11-14T17:01:46.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16012024-11-14T17:01:46.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16022024-11-14T17:01:46.725ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16032024-11-14T17:01:46.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16042024-11-14T17:01:46.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16052024-11-14T17:01:46.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16062024-11-14T17:01:46.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16072024-11-14T17:01:46.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16082024-11-14T17:01:46.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16092024-11-14T17:01:46.729ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16102024-11-14T17:01:46.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16112024-11-14T17:01:46.729ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16122024-11-14T17:01:46.730ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2230, tv_nsec: 460727563 } })
16132024-11-14T17:01:46.730ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
16142024-11-14T17:01:46.731ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16152024-11-14T17:01:46.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16162024-11-14T17:01:46.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16172024-11-14T17:01:46.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16182024-11-14T17:01:46.732ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16192024-11-14T17:01:46.732ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16202024-11-14T17:01:46.732ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 24.37723ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16212024-11-14T17:01:46.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16222024-11-14T17:01:46.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16232024-11-14T17:01:46.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16242024-11-14T17:01:46.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c6f0370b-24a7-4ad7-9fd2-7062953efe2d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
16252024-11-14T17:01:46.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c6f0370b-24a7-4ad7-9fd2-7062953efe2d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
16262024-11-14T17:01:46.770ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.993489ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16272024-11-14T17:01:46.770ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16282024-11-14T17:01:46.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16292024-11-14T17:01:46.771ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16302024-11-14T17:01:46.771ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
16312024-11-14T17:01:46.771ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16322024-11-14T17:01:46.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16332024-11-14T17:01:46.776ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16342024-11-14T17:01:46.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16352024-11-14T17:01:46.782ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 72.406393ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
16362024-11-14T17:01:46.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16372024-11-14T17:01:46.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
16382024-11-14T17:01:46.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16392024-11-14T17:01:46.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16402024-11-14T17:01:46.795ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 86.749007ms iteration = 19 status = {"physical_disks_added":0}
16412024-11-14T17:01:46.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16422024-11-14T17:01:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16432024-11-14T17:01:46.851ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
16442024-11-14T17:01:46.851ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16452024-11-14T17:01:46.851ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6821a554-a8b7-420d-a9c3-2dcbf24bdb93", "content-length": "26", "date": "Thu, 14 Nov 2024 17:01:46 GMT"} })
16462024-11-14T17:01:46.851ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16472024-11-14T17:01:46.853ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16482024-11-14T17:01:46.884ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16492024-11-14T17:01:46.884ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16502024-11-14T17:01:46.884ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "58b2e033-5cdc-40c3-8396-b2570e78a40f", "content-length": "372", "date": "Thu, 14 Nov 2024 17:01:46 GMT"} })
16512024-11-14T17:01:46.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16522024-11-14T17:01:46.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16532024-11-14T17:01:46.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16542024-11-14T17:01:46.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c6f0370b-24a7-4ad7-9fd2-7062953efe2d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
16552024-11-14T17:01:46.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16562024-11-14T17:01:46.914ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
16572024-11-14T17:01:46.914ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 206.064189ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
16582024-11-14T17:01:46.927ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
16592024-11-14T17:01:46.927ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16602024-11-14T17:01:46.928ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9928f04e-f3ae-42a1-aaeb-7794a216ddca", "content-length": "26", "date": "Thu, 14 Nov 2024 17:01:46 GMT"} })
16612024-11-14T17:01:46.928ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16622024-11-14T17:01:46.930ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16632024-11-14T17:01:46.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 224.098156ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16642024-11-14T17:01:46.933ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16652024-11-14T17:01:46.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 224.061545ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
16662024-11-14T17:01:46.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
16672024-11-14T17:01:46.937ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16682024-11-14T17:01:46.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16692024-11-14T17:01:46.939ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 230.928811ms iteration = 16 status = 0
16702024-11-14T17:01:46.941ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16712024-11-14T17:01:46.941ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16722024-11-14T17:01:46.941ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 233.445117ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16732024-11-14T17:01:46.948ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
16742024-11-14T17:01:46.948ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16752024-11-14T17:01:46.948ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53ca689a-4639-4af8-85fe-34ce1368ea73", "content-length": "26", "date": "Thu, 14 Nov 2024 17:01:46 GMT"} })
16762024-11-14T17:01:46.948ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16772024-11-14T17:01:46.950ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
16782024-11-14T17:01:46.951ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
16792024-11-14T17:01:46.951ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16802024-11-14T17:01:46.951ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b42b1c21-b46b-4978-b3f4-af5b90be0dfe", "date": "Thu, 14 Nov 2024 17:01:46 GMT"} })
16812024-11-14T17:01:46.951ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16822024-11-14T17:01:46.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16832024-11-14T17:01:46.953ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16842024-11-14T17:01:46.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16852024-11-14T17:01:46.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16862024-11-14T17:01:46.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16872024-11-14T17:01:46.960ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16882024-11-14T17:01:46.960ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16892024-11-14T17:01:46.961ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bae84454-b289-449a-9273-1ed2729399ae", "date": "Thu, 14 Nov 2024 17:01:46 GMT"} })
16902024-11-14T17:01:46.962ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 254.365719ms iteration = 17 status = {}
16912024-11-14T17:01:46.990ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 281.638865ms iteration = 16 status = {}
16922024-11-14T17:01:47.006ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16932024-11-14T17:01:47.006ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "898c24f5-2ddd-4ec6-b820-b69fda1bad10", "content-length": "1", "date": "Thu, 14 Nov 2024 17:01:46 GMT"} })
16942024-11-14T17:01:47.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16952024-11-14T17:01:47.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16962024-11-14T17:01:47.008ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16972024-11-14T17:01:47.008ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16982024-11-14T17:01:47.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16992024-11-14T17:01:47.011ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 303.066168ms iteration = 16 status = null
17002024-11-14T17:01:47.014ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17012024-11-14T17:01:47.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17022024-11-14T17:01:47.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17032024-11-14T17:01:47.016ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17042024-11-14T17:01:47.017ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17052024-11-14T17:01:47.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17062024-11-14T17:01:47.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17072024-11-14T17:01:47.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17082024-11-14T17:01:47.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17092024-11-14T17:01:47.091ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
17102024-11-14T17:01:47.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17112024-11-14T17:01:47.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17122024-11-14T17:01:47.107ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17132024-11-14T17:01:47.107ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "962383a1-3738-4daa-9da1-8095a6c75bf1", "content-length": "134", "date": "Thu, 14 Nov 2024 17:01:46 GMT"} })
17142024-11-14T17:01:47.107ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17152024-11-14T17:01:47.107ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
17162024-11-14T17:01:47.107ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17172024-11-14T17:01:47.107ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17182024-11-14T17:01:47.107ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17192024-11-14T17:01:47.107ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17202024-11-14T17:01:47.107ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17212024-11-14T17:01:47.107ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17222024-11-14T17:01:47.108ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17232024-11-14T17:01:47.108ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17242024-11-14T17:01:47.108ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
17252024-11-14T17:01:47.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17262024-11-14T17:01:47.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17272024-11-14T17:01:47.110ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17282024-11-14T17:01:47.111ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec168a72-33ce-4f3e-a929-3af0921206a6", "content-length": "2", "date": "Thu, 14 Nov 2024 17:01:46 GMT"} })
17292024-11-14T17:01:47.111ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17302024-11-14T17:01:47.111ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac2c556d-a3ab-4c7d-9ca2-5fc72b52ef77", "content-length": "52", "date": "Thu, 14 Nov 2024 17:01:46 GMT"} })
17312024-11-14T17:01:47.111ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
17322024-11-14T17:01:47.111ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17332024-11-14T17:01:47.126ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17342024-11-14T17:01:47.217ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "86f63594-3843-44b7-a944-18df1fc8e117", "date": "Thu, 14 Nov 2024 17:01:46 GMT"} })
17352024-11-14T17:01:47.217ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
17362024-11-14T17:01:47.217ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17372024-11-14T17:01:47.218ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a00535b-2c69-46d8-84fc-270729b91cdd", "content-length": "682", "date": "Thu, 14 Nov 2024 17:01:47 GMT"} })
17382024-11-14T17:01:47.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17392024-11-14T17:01:47.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17402024-11-14T17:01:47.218ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f51de594-c5ec-40bc-baa7-dbc5e25a4aca", "content-length": "691", "date": "Thu, 14 Nov 2024 17:01:47 GMT"} })
17412024-11-14T17:01:47.218ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
17422024-11-14T17:01:47.218ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
17432024-11-14T17:01:47.218ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
17442024-11-14T17:01:47.220ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 511.901629ms iteration = 16 status = {}
17452024-11-14T17:01:47.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17462024-11-14T17:01:47.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17472024-11-14T17:01:47.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17482024-11-14T17:01:47.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17492024-11-14T17:01:47.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17502024-11-14T17:01:47.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17512024-11-14T17:01:47.237ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 528.427313ms iteration = 16 status = {}
17522024-11-14T17:01:47.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 016940dd-0781-4449-845f-80f4841e0372 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17532024-11-14T17:01:47.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 016940dd-0781-4449-845f-80f4841e0372 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17542024-11-14T17:01:47.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 016940dd-0781-4449-845f-80f4841e0372 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17552024-11-14T17:01:47.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 71244e27-df01-4667-9e52-39c98a09a544 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
17562024-11-14T17:01:47.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 71244e27-df01-4667-9e52-39c98a09a544 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
17572024-11-14T17:01:47.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 71244e27-df01-4667-9e52-39c98a09a544 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
17582024-11-14T17:01:48.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 469f4538-c4da-4621-b81a-21a3982ca23e roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17592024-11-14T17:01:48.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 469f4538-c4da-4621-b81a-21a3982ca23e resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17602024-11-14T17:01:48.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 469f4538-c4da-4621-b81a-21a3982ca23e response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17612024-11-14T17:01:49.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f6ee5e8c-a424-40da-9d7f-5f55fff6ecda roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17622024-11-14T17:01:49.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f6ee5e8c-a424-40da-9d7f-5f55fff6ecda resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17632024-11-14T17:01:49.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f6ee5e8c-a424-40da-9d7f-5f55fff6ecda response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17642024-11-14T17:01:50.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 61b2fc09-f07b-482c-a714-de58e197f4f1 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17652024-11-14T17:01:50.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 61b2fc09-f07b-482c-a714-de58e197f4f1 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17662024-11-14T17:01:50.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 61b2fc09-f07b-482c-a714-de58e197f4f1 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17672024-11-14T17:01:51.099ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:62174
17682024-11-14T17:01:51.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62174 req_id = 0ae47f66-413c-45e5-b6d8-a185caabd3b3 roles = RoleSet { roles: {} } uri = /metrics/producers
17692024-11-14T17:01:51.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62174 req_id = 0ae47f66-413c-45e5-b6d8-a185caabd3b3 resource = Database result = Ok(()) uri = /metrics/producers
17702024-11-14T17:01:51.137ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = 743a3e75-8669-4b5c-90ad-c360bf17cd8e
17712024-11-14T17:01:51.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37661 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62174 req_id = 0ae47f66-413c-45e5-b6d8-a185caabd3b3 response_code = 201 uri = /metrics/producers
17722024-11-14T17:01:52.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2aa8e567-e66e-4103-bb80-8eb3a4451ed0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17732024-11-14T17:01:52.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2aa8e567-e66e-4103-bb80-8eb3a4451ed0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17742024-11-14T17:01:52.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2aa8e567-e66e-4103-bb80-8eb3a4451ed0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17752024-11-14T17:01:53.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ad6c9995-acbc-4a74-bcad-d38898aa219a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17762024-11-14T17:01:53.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ad6c9995-acbc-4a74-bcad-d38898aa219a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17772024-11-14T17:01:53.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ad6c9995-acbc-4a74-bcad-d38898aa219a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17782024-11-14T17:01:54.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7bda25a4-3b9c-45c1-a31b-fe230a40929d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17792024-11-14T17:01:54.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7bda25a4-3b9c-45c1-a31b-fe230a40929d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17802024-11-14T17:01:54.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7bda25a4-3b9c-45c1-a31b-fe230a40929d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17812024-11-14T17:01:55.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4a99b8e0-16db-40a4-b202-baa473b7c223 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17822024-11-14T17:01:55.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4a99b8e0-16db-40a4-b202-baa473b7c223 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17832024-11-14T17:01:55.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4a99b8e0-16db-40a4-b202-baa473b7c223 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17842024-11-14T17:01:56.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b2f323ea-e5ad-4154-b8a2-90eb011d3417 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17852024-11-14T17:01:56.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b2f323ea-e5ad-4154-b8a2-90eb011d3417 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17862024-11-14T17:01:56.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b2f323ea-e5ad-4154-b8a2-90eb011d3417 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
17872024-11-14T17:01:56.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 249f836a-4050-4e8c-b4ab-abf13fbb7214 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
17882024-11-14T17:01:56.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
17892024-11-14T17:01:56.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17902024-11-14T17:01:56.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
17912024-11-14T17:01:56.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17922024-11-14T17:01:56.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17932024-11-14T17:01:56.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17942024-11-14T17:01:56.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17952024-11-14T17:01:56.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17962024-11-14T17:01:56.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17972024-11-14T17:01:56.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17982024-11-14T17:01:56.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17992024-11-14T17:01:56.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18002024-11-14T17:01:56.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18012024-11-14T17:01:56.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
18022024-11-14T17:01:56.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18032024-11-14T17:01:56.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18042024-11-14T17:01:56.727ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
18052024-11-14T17:01:56.727ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.712764ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
18062024-11-14T17:01:56.743ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18072024-11-14T17:01:56.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18082024-11-14T17:01:56.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.004372ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18092024-11-14T17:01:57.077ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:35663
18102024-11-14T17:01:57.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35663 req_id = 7a0b431a-7739-4a11-8ce5-e64b54ff95f7 roles = RoleSet { roles: {} } uri = /metrics/producers
18112024-11-14T17:01:57.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35663 req_id = 7a0b431a-7739-4a11-8ce5-e64b54ff95f7 resource = Database result = Ok(()) uri = /metrics/producers
18122024-11-14T17:01:57.115ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = 6bd40b29-f0a0-4b84-a1e1-0a83cff94df0
18132024-11-14T17:01:57.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38098 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35663 req_id = 7a0b431a-7739-4a11-8ce5-e64b54ff95f7 response_code = 201 uri = /metrics/producers
18142024-11-14T17:01:57.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7bb2c1c4-4e32-4cb2-8c44-50f7b8180ee6 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18152024-11-14T17:01:57.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7bb2c1c4-4e32-4cb2-8c44-50f7b8180ee6 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18162024-11-14T17:01:57.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7bb2c1c4-4e32-4cb2-8c44-50f7b8180ee6 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18172024-11-14T17:01:58.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fdd8e738-764f-4764-acee-419d36c5bab1 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18182024-11-14T17:01:58.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fdd8e738-764f-4764-acee-419d36c5bab1 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18192024-11-14T17:01:58.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fdd8e738-764f-4764-acee-419d36c5bab1 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18202024-11-14T17:01:59.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 71d8b96d-b95e-4d33-849f-88d8e3041b7e roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18212024-11-14T17:01:59.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 71d8b96d-b95e-4d33-849f-88d8e3041b7e resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18222024-11-14T17:01:59.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 71d8b96d-b95e-4d33-849f-88d8e3041b7e response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18232024-11-14T17:02:00.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8f413429-a55c-4e9d-a481-2b2b911d1ca5 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18242024-11-14T17:02:00.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8f413429-a55c-4e9d-a481-2b2b911d1ca5 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18252024-11-14T17:02:00.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1813 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8f413429-a55c-4e9d-a481-2b2b911d1ca5 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18262024-11-14T17:02:01.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fea920e8-31c2-4e44-98bc-8e11c63a88b6 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18272024-11-14T17:02:01.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fea920e8-31c2-4e44-98bc-8e11c63a88b6 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18282024-11-14T17:02:01.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fea920e8-31c2-4e44-98bc-8e11c63a88b6 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18292024-11-14T17:02:02.035ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:45222
18302024-11-14T17:02:02.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45222 req_id = 1b700689-f75a-40bb-b4b4-99eba1fc5b3d roles = RoleSet { roles: {} } uri = /metrics/producers
18312024-11-14T17:02:02.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45222 req_id = 1b700689-f75a-40bb-b4b4-99eba1fc5b3d resource = Database result = Ok(()) uri = /metrics/producers
18322024-11-14T17:02:02.080ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
18332024-11-14T17:02:02.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45239 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45222 req_id = 1b700689-f75a-40bb-b4b4-99eba1fc5b3d response_code = 201 uri = /metrics/producers
18342024-11-14T17:02:02.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2aa2937a-4d3a-44d1-8676-427ca550c275 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18352024-11-14T17:02:02.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2aa2937a-4d3a-44d1-8676-427ca550c275 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18362024-11-14T17:02:02.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2aa2937a-4d3a-44d1-8676-427ca550c275 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18372024-11-14T17:02:02.789ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:64255
18382024-11-14T17:02:02.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64255 req_id = fc3e7d2a-3132-4eab-8140-9c87441252d0 roles = RoleSet { roles: {} } uri = /metrics/producers
18392024-11-14T17:02:02.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64255 req_id = fc3e7d2a-3132-4eab-8140-9c87441252d0 resource = Database result = Ok(()) uri = /metrics/producers
18402024-11-14T17:02:02.802ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = 96e8c35c-9335-4348-babf-c56b7d06c593
18412024-11-14T17:02:02.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12714 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64255 req_id = fc3e7d2a-3132-4eab-8140-9c87441252d0 response_code = 201 uri = /metrics/producers
18422024-11-14T17:02:03.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7cbf7ec6-07c0-4458-a549-3e113e174438 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18432024-11-14T17:02:03.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7cbf7ec6-07c0-4458-a549-3e113e174438 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18442024-11-14T17:02:03.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7cbf7ec6-07c0-4458-a549-3e113e174438 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18452024-11-14T17:02:03.446ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:55795
18462024-11-14T17:02:03.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55795 req_id = 1a6585a9-42ea-4ac8-8568-564184e71b93 roles = RoleSet { roles: {} } uri = /metrics/producers
18472024-11-14T17:02:03.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55795 req_id = 1a6585a9-42ea-4ac8-8568-564184e71b93 resource = Database result = Ok(()) uri = /metrics/producers
18482024-11-14T17:02:03.456ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = 973cae68-7270-4bdc-af1f-f9462c2eb9cf
18492024-11-14T17:02:03.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10442 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55795 req_id = 1a6585a9-42ea-4ac8-8568-564184e71b93 response_code = 201 uri = /metrics/producers
18502024-11-14T17:02:03.563ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:40587
18512024-11-14T17:02:03.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40587 req_id = 9d4f4600-11fa-4fbf-aefa-5249c60adfe8 roles = RoleSet { roles: {} } uri = /metrics/producers
18522024-11-14T17:02:03.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40587 req_id = 9d4f4600-11fa-4fbf-aefa-5249c60adfe8 resource = Database result = Ok(()) uri = /metrics/producers
18532024-11-14T17:02:03.571ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = cd3068aa-0bb3-4c89-8df3-40f9024907ef
18542024-11-14T17:02:03.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7561 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40587 req_id = 9d4f4600-11fa-4fbf-aefa-5249c60adfe8 response_code = 201 uri = /metrics/producers
18552024-11-14T17:02:04.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6c49dbf9-5273-4dfb-bced-f8496bd940c6 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18562024-11-14T17:02:04.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6c49dbf9-5273-4dfb-bced-f8496bd940c6 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18572024-11-14T17:02:04.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6c49dbf9-5273-4dfb-bced-f8496bd940c6 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18582024-11-14T17:02:05.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9ef996f0-ee26-4a90-9c0f-d58b765df0d7 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18592024-11-14T17:02:05.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9ef996f0-ee26-4a90-9c0f-d58b765df0d7 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18602024-11-14T17:02:05.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9ef996f0-ee26-4a90-9c0f-d58b765df0d7 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18612024-11-14T17:02:06.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b3d912a4-51e5-40a5-8d42-e2d0c436cfaf roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18622024-11-14T17:02:06.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b3d912a4-51e5-40a5-8d42-e2d0c436cfaf resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18632024-11-14T17:02:06.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b3d912a4-51e5-40a5-8d42-e2d0c436cfaf response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18642024-11-14T17:02:06.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
18652024-11-14T17:02:06.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18662024-11-14T17:02:06.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
18672024-11-14T17:02:06.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18682024-11-14T17:02:06.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18692024-11-14T17:02:06.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18702024-11-14T17:02:06.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18712024-11-14T17:02:06.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18722024-11-14T17:02:06.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18732024-11-14T17:02:06.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18742024-11-14T17:02:06.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18752024-11-14T17:02:06.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18762024-11-14T17:02:06.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18772024-11-14T17:02:06.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18782024-11-14T17:02:06.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18792024-11-14T17:02:06.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
18802024-11-14T17:02:06.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18812024-11-14T17:02:06.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18822024-11-14T17:02:06.733ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
18832024-11-14T17:02:06.733ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.632105ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
18842024-11-14T17:02:06.743ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.900728ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18852024-11-14T17:02:07.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 38baf535-dc52-41c2-87b6-397af86a2848 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18862024-11-14T17:02:07.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 38baf535-dc52-41c2-87b6-397af86a2848 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18872024-11-14T17:02:07.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 38baf535-dc52-41c2-87b6-397af86a2848 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18882024-11-14T17:02:08.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9daa42fc-aa40-4274-bbbf-1b10d800ae7b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18892024-11-14T17:02:08.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9daa42fc-aa40-4274-bbbf-1b10d800ae7b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18902024-11-14T17:02:08.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9daa42fc-aa40-4274-bbbf-1b10d800ae7b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18912024-11-14T17:02:09.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8fa4e15f-6255-427b-91c9-b0d0bd05420c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18922024-11-14T17:02:09.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8fa4e15f-6255-427b-91c9-b0d0bd05420c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18932024-11-14T17:02:09.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2718 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8fa4e15f-6255-427b-91c9-b0d0bd05420c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18942024-11-14T17:02:10.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c19b0870-633a-4297-bfd3-6b269a9e32a2 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18952024-11-14T17:02:10.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c19b0870-633a-4297-bfd3-6b269a9e32a2 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18962024-11-14T17:02:10.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c19b0870-633a-4297-bfd3-6b269a9e32a2 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18972024-11-14T17:02:11.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c6355f43-3d67-4aba-9efa-f0e6ab070cc0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18982024-11-14T17:02:11.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c6355f43-3d67-4aba-9efa-f0e6ab070cc0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
18992024-11-14T17:02:11.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c6355f43-3d67-4aba-9efa-f0e6ab070cc0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
19002024-11-14T17:02:11.604ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1360 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 225e50db-a758-48b4-a68e-e9faca120d30 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
19012024-11-14T17:02:12.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b7720747-190f-4dc5-9f2d-8fa3eccb6c54 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
19022024-11-14T17:02:12.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b7720747-190f-4dc5-9f2d-8fa3eccb6c54 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
19032024-11-14T17:02:12.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b7720747-190f-4dc5-9f2d-8fa3eccb6c54 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
19042024-11-14T17:02:13.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ef7b253b-39f3-44aa-90be-e5180286b1d5 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
19052024-11-14T17:02:13.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ef7b253b-39f3-44aa-90be-e5180286b1d5 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
19062024-11-14T17:02:13.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ef7b253b-39f3-44aa-90be-e5180286b1d5 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
19072024-11-14T17:02:14.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 708f28b1-7f24-4929-834c-8953927949bc roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
19082024-11-14T17:02:14.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 708f28b1-7f24-4929-834c-8953927949bc resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
19092024-11-14T17:02:14.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 708f28b1-7f24-4929-834c-8953927949bc response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
19102024-11-14T17:02:15.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2961a4c4-2f3a-4e23-ac66-de92eec605a9 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
19112024-11-14T17:02:15.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2961a4c4-2f3a-4e23-ac66-de92eec605a9 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
19122024-11-14T17:02:15.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2961a4c4-2f3a-4e23-ac66-de92eec605a9 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
19132024-11-14T17:02:16.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cd121070-9cda-44f3-8eb9-3f300ee5ff4a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
19142024-11-14T17:02:16.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cd121070-9cda-44f3-8eb9-3f300ee5ff4a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
19152024-11-14T17:02:16.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cd121070-9cda-44f3-8eb9-3f300ee5ff4a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
19162024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
19172024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
19182024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19192024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19202024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
19212024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
19222024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
19232024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19242024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19252024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
19262024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19272024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
19282024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
19292024-11-14T17:02:16.708ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5
19302024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.571\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5"}
19312024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
19322024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
19332024-11-14T17:02:16.708ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19342024-11-14T17:02:16.708ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
19352024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19362024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19372024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19382024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
19392024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
19402024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19412024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19422024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
19432024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19442024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
19452024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
19462024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19472024-11-14T17:02:16.709ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 16:52:16.709011491 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
19482024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
19492024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
19502024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19512024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
19522024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19532024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
19542024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
19552024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
19562024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19572024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19582024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
19592024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
19602024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
19612024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19622024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
19632024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
19642024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
19652024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
19662024-11-14T17:02:16.709ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
19672024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
19682024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
19692024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19702024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19712024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
19722024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
19732024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19742024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19752024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
19762024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
19772024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19782024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19792024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19802024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19812024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19822024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19832024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19842024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19852024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19862024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19872024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19882024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19892024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19902024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
19912024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19922024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19932024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
19942024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19952024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19962024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19972024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19982024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
19992024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20002024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20012024-11-14T17:02:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20022024-11-14T17:02:16.709ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94482e71-9503-4d09-b73f-615fbf343a2e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2260, tv_nsec: 439949925 } })
20032024-11-14T17:02:16.709ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89b01be2-c37f-445d-addd-6b4be9cd73c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc5fdca1-6d92-4ff4-b5ae-2f44553a2186.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2260, tv_nsec: 439961875 } })
20042024-11-14T17:02:16.710ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
20052024-11-14T17:02:16.710ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.432422ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
20062024-11-14T17:02:16.710ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
20072024-11-14T17:02:16.710ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.445303ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
20082024-11-14T17:02:16.711ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20092024-11-14T17:02:16.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20102024-11-14T17:02:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20112024-11-14T17:02:16.712ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20122024-11-14T17:02:16.713ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.784898ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20132024-11-14T17:02:16.713ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20142024-11-14T17:02:16.713ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20152024-11-14T17:02:16.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20162024-11-14T17:02:16.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20172024-11-14T17:02:16.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20182024-11-14T17:02:16.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20192024-11-14T17:02:16.716ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20202024-11-14T17:02:16.716ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20212024-11-14T17:02:16.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20222024-11-14T17:02:16.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20232024-11-14T17:02:16.718ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20242024-11-14T17:02:16.718ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20252024-11-14T17:02:16.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20262024-11-14T17:02:16.720ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2260, tv_nsec: 450580375 } })
20272024-11-14T17:02:16.720ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
20282024-11-14T17:02:16.721ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 16:52:16.709011491 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
20292024-11-14T17:02:16.721ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.368359ms iteration = 9 status = {"expiration":"2024-11-14T16:52:16.709011491Z","pruned":[]}
20302024-11-14T17:02:16.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20312024-11-14T17:02:16.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20322024-11-14T17:02:16.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20332024-11-14T17:02:16.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20342024-11-14T17:02:16.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20352024-11-14T17:02:16.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20362024-11-14T17:02:16.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20372024-11-14T17:02:16.733ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2260, tv_nsec: 463882925 } })
20382024-11-14T17:02:16.734ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
20392024-11-14T17:02:16.740ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20402024-11-14T17:02:16.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
20412024-11-14T17:02:16.744ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20422024-11-14T17:02:16.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20432024-11-14T17:02:16.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20442024-11-14T17:02:16.747ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 38.220802ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
20452024-11-14T17:02:16.748ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20462024-11-14T17:02:16.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20472024-11-14T17:02:16.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20482024-11-14T17:02:16.752ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2260, tv_nsec: 482631328 } })
20492024-11-14T17:02:16.753ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
20502024-11-14T17:02:16.754ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20512024-11-14T17:02:16.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20522024-11-14T17:02:16.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20532024-11-14T17:02:16.761ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20542024-11-14T17:02:16.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20552024-11-14T17:02:16.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20562024-11-14T17:02:16.764ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20572024-11-14T17:02:16.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20582024-11-14T17:02:16.774ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.268113ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
20592024-11-14T17:02:16.776ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20602024-11-14T17:02:16.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20612024-11-14T17:02:16.780ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20622024-11-14T17:02:16.781ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.23789ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20632024-11-14T17:02:16.784ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20642024-11-14T17:02:16.784ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20652024-11-14T17:02:16.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20662024-11-14T17:02:16.785ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20672024-11-14T17:02:16.785ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.23499ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20682024-11-14T17:02:16.786ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20692024-11-14T17:02:16.789ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20702024-11-14T17:02:16.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20712024-11-14T17:02:16.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20722024-11-14T17:02:16.790ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20732024-11-14T17:02:16.790ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20742024-11-14T17:02:16.790ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20752024-11-14T17:02:16.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20762024-11-14T17:02:16.803ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20772024-11-14T17:02:16.803ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20782024-11-14T17:02:16.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20792024-11-14T17:02:16.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20802024-11-14T17:02:16.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 97.51797ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
20812024-11-14T17:02:16.808ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
20822024-11-14T17:02:16.808ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
20832024-11-14T17:02:16.808ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 99.078476ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
20842024-11-14T17:02:16.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20852024-11-14T17:02:16.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 101.95535ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20862024-11-14T17:02:16.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20872024-11-14T17:02:16.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20882024-11-14T17:02:16.815ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20892024-11-14T17:02:16.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20902024-11-14T17:02:16.815ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20912024-11-14T17:02:16.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20922024-11-14T17:02:16.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20932024-11-14T17:02:16.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20942024-11-14T17:02:16.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20952024-11-14T17:02:16.817ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
20962024-11-14T17:02:16.817ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
20972024-11-14T17:02:16.817ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 107.982776ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
20982024-11-14T17:02:16.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20992024-11-14T17:02:16.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21002024-11-14T17:02:16.828ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21012024-11-14T17:02:16.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21022024-11-14T17:02:16.832ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
21032024-11-14T17:02:16.832ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
21042024-11-14T17:02:16.832ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
21052024-11-14T17:02:16.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21062024-11-14T17:02:16.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21072024-11-14T17:02:16.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
21082024-11-14T17:02:16.833ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21092024-11-14T17:02:16.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21102024-11-14T17:02:16.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21112024-11-14T17:02:16.834ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21122024-11-14T17:02:16.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21132024-11-14T17:02:16.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
21142024-11-14T17:02:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
21152024-11-14T17:02:16.866ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
21162024-11-14T17:02:16.866ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
21172024-11-14T17:02:16.866ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
21182024-11-14T17:02:16.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21192024-11-14T17:02:16.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21202024-11-14T17:02:16.867ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
21212024-11-14T17:02:16.868ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21222024-11-14T17:02:16.869ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21232024-11-14T17:02:16.869ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 159.896518ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21242024-11-14T17:02:16.886ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
21252024-11-14T17:02:16.886ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21262024-11-14T17:02:16.887ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "78a35fa6-3d71-4c06-adad-14a5904ee87a", "content-length": "26", "date": "Thu, 14 Nov 2024 17:02:16 GMT"} })
21272024-11-14T17:02:16.887ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21282024-11-14T17:02:16.889ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21292024-11-14T17:02:16.923ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
21302024-11-14T17:02:16.923ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21312024-11-14T17:02:16.923ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "70ea3d8a-c81a-47e3-9714-61a878ea8da3", "content-length": "26", "date": "Thu, 14 Nov 2024 17:02:16 GMT"} })
21322024-11-14T17:02:16.923ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21332024-11-14T17:02:16.925ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21342024-11-14T17:02:16.935ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21352024-11-14T17:02:16.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21362024-11-14T17:02:16.977ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
21372024-11-14T17:02:16.997ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21382024-11-14T17:02:16.997ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21392024-11-14T17:02:16.998ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8d29282-eefd-4b47-b300-282dfebe75ea", "content-length": "372", "date": "Thu, 14 Nov 2024 17:02:16 GMT"} })
21402024-11-14T17:02:16.998ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21412024-11-14T17:02:16.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21422024-11-14T17:02:17.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21432024-11-14T17:02:17.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21442024-11-14T17:02:17.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21452024-11-14T17:02:17.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21462024-11-14T17:02:17.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21472024-11-14T17:02:17.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21482024-11-14T17:02:17.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21492024-11-14T17:02:17.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21502024-11-14T17:02:17.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21512024-11-14T17:02:17.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
21522024-11-14T17:02:17.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21532024-11-14T17:02:17.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21542024-11-14T17:02:17.034ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
21552024-11-14T17:02:17.034ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 325.151787ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
21562024-11-14T17:02:17.038ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21572024-11-14T17:02:17.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21582024-11-14T17:02:17.039ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21592024-11-14T17:02:17.043ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21602024-11-14T17:02:17.043ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21612024-11-14T17:02:17.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21622024-11-14T17:02:17.044ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
21632024-11-14T17:02:17.044ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21642024-11-14T17:02:17.045ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d1b6b7d-0590-4545-be99-fa29451318ef", "content-length": "26", "date": "Thu, 14 Nov 2024 17:02:16 GMT"} })
21652024-11-14T17:02:17.045ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21662024-11-14T17:02:17.046ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
21672024-11-14T17:02:17.047ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 338.717422ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
21682024-11-14T17:02:17.049ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
21692024-11-14T17:02:17.049ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
21702024-11-14T17:02:17.049ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21712024-11-14T17:02:17.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21722024-11-14T17:02:17.051ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21732024-11-14T17:02:17.054ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 345.022234ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
21742024-11-14T17:02:17.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21752024-11-14T17:02:17.054ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21762024-11-14T17:02:17.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21772024-11-14T17:02:17.056ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21782024-11-14T17:02:17.057ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
21792024-11-14T17:02:17.057ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
21802024-11-14T17:02:17.057ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 16:54:46.198050 UTC dns_group = internal generation = 1
21812024-11-14T17:02:17.057ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 348.468432ms iteration = 10 status = {"generation":1}
21822024-11-14T17:02:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21832024-11-14T17:02:17.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21842024-11-14T17:02:17.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21852024-11-14T17:02:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21862024-11-14T17:02:17.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
21872024-11-14T17:02:17.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21882024-11-14T17:02:17.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21892024-11-14T17:02:17.066ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 357.774332ms iteration = 17 status = 0
21902024-11-14T17:02:17.075ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
21912024-11-14T17:02:17.075ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21922024-11-14T17:02:17.075ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2b25c8dc-18d1-47c0-98a9-700f7f222d5b", "date": "Thu, 14 Nov 2024 17:02:16 GMT"} })
21932024-11-14T17:02:17.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21942024-11-14T17:02:17.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21952024-11-14T17:02:17.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21962024-11-14T17:02:17.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21972024-11-14T17:02:17.083ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21982024-11-14T17:02:17.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21992024-11-14T17:02:17.086ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22002024-11-14T17:02:17.086ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22012024-11-14T17:02:17.087ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b3e456f7-5651-4152-9940-cf6a281445f2", "date": "Thu, 14 Nov 2024 17:02:16 GMT"} })
22022024-11-14T17:02:17.089ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 380.400572ms iteration = 18 status = {}
22032024-11-14T17:02:17.090ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T16:54:14.392760Z, time_modified: 2024-11-14T16:54:14.392760Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }) }
22042024-11-14T17:02:17.090ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 381.412656ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]}},"default_endpoint":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
22052024-11-14T17:02:17.093ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
22062024-11-14T17:02:17.105ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
22072024-11-14T17:02:17.106ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9637b175-4096-4619-aaff-6f5735397a4a", "content-length": "1", "date": "Thu, 14 Nov 2024 17:02:16 GMT"} })
22082024-11-14T17:02:17.108ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22092024-11-14T17:02:17.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22102024-11-14T17:02:17.111ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 402.776088ms iteration = 17 status = null
22112024-11-14T17:02:17.133ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
22122024-11-14T17:02:17.133ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 0 version = 2
22132024-11-14T17:02:17.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22142024-11-14T17:02:17.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22152024-11-14T17:02:17.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22162024-11-14T17:02:17.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22172024-11-14T17:02:17.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22182024-11-14T17:02:17.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22192024-11-14T17:02:17.144ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 1 version = 2
22202024-11-14T17:02:17.144ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
22212024-11-14T17:02:17.144ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 16:54:47.468912 UTC dns_group = external generation = 2
22222024-11-14T17:02:17.144ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 435.538146ms iteration = 10 status = {"generation":2}
22232024-11-14T17:02:17.149ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
22242024-11-14T17:02:17.149ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 440.852326ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
22252024-11-14T17:02:17.152ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22262024-11-14T17:02:17.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22272024-11-14T17:02:17.154ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22282024-11-14T17:02:17.154ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 445.928631ms iteration = 20 status = {"physical_disks_added":0}
22292024-11-14T17:02:17.156ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
22302024-11-14T17:02:17.156ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6067863c-9564-425c-8aa1-0ceef0384cda", "date": "Thu, 14 Nov 2024 17:02:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22312024-11-14T17:02:17.156ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22322024-11-14T17:02:17.157ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22332024-11-14T17:02:17.157ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22342024-11-14T17:02:17.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22352024-11-14T17:02:17.159ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "22ac1ad2-6308-428e-b82d-c0f701200d2a", "date": "Thu, 14 Nov 2024 17:02:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22362024-11-14T17:02:17.159ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22372024-11-14T17:02:17.159ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22382024-11-14T17:02:17.160ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 450.929694ms iteration = 17 status = {}
22392024-11-14T17:02:17.161ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22402024-11-14T17:02:17.161ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 452.467629ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
22412024-11-14T17:02:17.162ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22422024-11-14T17:02:17.162ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22432024-11-14T17:02:17.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22442024-11-14T17:02:17.206ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
22452024-11-14T17:02:17.207ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "89a4d9f5-bbcf-45f0-be83-bb17e7b6ac55", "date": "Thu, 14 Nov 2024 17:02:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
22462024-11-14T17:02:17.207ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
22472024-11-14T17:02:17.208ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0bc8623c-dd5f-4b05-b2d6-6466cbe5302e", "date": "Thu, 14 Nov 2024 17:02:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
22482024-11-14T17:02:17.208ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
22492024-11-14T17:02:17.211ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a96b8915-76b4-4caf-a075-54c59441798e", "date": "Thu, 14 Nov 2024 17:02:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
22502024-11-14T17:02:17.211ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
22512024-11-14T17:02:17.213ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
22522024-11-14T17:02:17.213ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 504.455122ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
22532024-11-14T17:02:17.297ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22542024-11-14T17:02:17.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22552024-11-14T17:02:17.300ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
22562024-11-14T17:02:17.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22572024-11-14T17:02:17.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22582024-11-14T17:02:17.307ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22592024-11-14T17:02:17.313ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22602024-11-14T17:02:17.314ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca04bce1-f0c2-47e8-b23a-6ffcaddcb468", "content-length": "134", "date": "Thu, 14 Nov 2024 17:02:17 GMT"} })
22612024-11-14T17:02:17.314ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
22622024-11-14T17:02:17.314ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
22632024-11-14T17:02:17.314ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22642024-11-14T17:02:17.314ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22652024-11-14T17:02:17.314ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22662024-11-14T17:02:17.314ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22672024-11-14T17:02:17.314ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22682024-11-14T17:02:17.314ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22692024-11-14T17:02:17.314ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22702024-11-14T17:02:17.314ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22712024-11-14T17:02:17.314ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
22722024-11-14T17:02:17.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22732024-11-14T17:02:17.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22742024-11-14T17:02:17.328ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22752024-11-14T17:02:17.328ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2c4eb4f-7b8c-4120-b641-1bc350c691f8", "content-length": "2", "date": "Thu, 14 Nov 2024 17:02:17 GMT"} })
22762024-11-14T17:02:17.328ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22772024-11-14T17:02:17.328ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0402d53-5a0e-4254-94fc-5e0ef427f0f6", "content-length": "52", "date": "Thu, 14 Nov 2024 17:02:17 GMT"} })
22782024-11-14T17:02:17.328ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
22792024-11-14T17:02:17.328ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22802024-11-14T17:02:17.399ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "083b578e-4968-4757-93e1-d89e79966a43", "content-length": "691", "date": "Thu, 14 Nov 2024 17:02:17 GMT"} })
22812024-11-14T17:02:17.399ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
22822024-11-14T17:02:17.399ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
22832024-11-14T17:02:17.399ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
22842024-11-14T17:02:17.401ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 692.449034ms iteration = 17 status = {}
22852024-11-14T17:02:17.505ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e16cf60c-dfbf-4047-a810-785cd8638265", "date": "Thu, 14 Nov 2024 17:02:17 GMT"} })
22862024-11-14T17:02:17.505ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
22872024-11-14T17:02:17.505ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22882024-11-14T17:02:17.509ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "33170727-eb3c-457d-8075-a86f9175ca2e", "content-length": "682", "date": "Thu, 14 Nov 2024 17:02:17 GMT"} })
22892024-11-14T17:02:17.509ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22902024-11-14T17:02:17.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22912024-11-14T17:02:17.513ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22922024-11-14T17:02:17.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22932024-11-14T17:02:17.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22942024-11-14T17:02:17.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22952024-11-14T17:02:17.520ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22962024-11-14T17:02:17.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22972024-11-14T17:02:17.527ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 818.647019ms iteration = 17 status = {}
22982024-11-14T17:02:17.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 49f05939-cc3d-41bd-ade8-4a7643ce5925 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
22992024-11-14T17:02:17.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 49f05939-cc3d-41bd-ade8-4a7643ce5925 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23002024-11-14T17:02:17.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 49f05939-cc3d-41bd-ade8-4a7643ce5925 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23012024-11-14T17:02:17.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 612e77d1-0eef-40fd-a161-e10669e084df roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
23022024-11-14T17:02:17.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 612e77d1-0eef-40fd-a161-e10669e084df resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
23032024-11-14T17:02:17.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3291 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 612e77d1-0eef-40fd-a161-e10669e084df response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
23042024-11-14T17:02:18.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a6db2049-22a9-472a-bcf6-00bc5c677169 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23052024-11-14T17:02:18.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a6db2049-22a9-472a-bcf6-00bc5c677169 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23062024-11-14T17:02:18.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a6db2049-22a9-472a-bcf6-00bc5c677169 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23072024-11-14T17:02:18.797ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
23082024-11-14T17:02:18.797ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
23092024-11-14T17:02:18.828ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
23102024-11-14T17:02:18.828ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:38012
23112024-11-14T17:02:18.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38012 req_id = 37b50a33-c1f5-463a-a2bf-d90c465b9066 roles = RoleSet { roles: {} } uri = /metrics/producers
23122024-11-14T17:02:18.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38012 req_id = 37b50a33-c1f5-463a-a2bf-d90c465b9066 resource = Database result = Ok(()) uri = /metrics/producers
23132024-11-14T17:02:18.875ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
23142024-11-14T17:02:18.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46010 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38012 req_id = 37b50a33-c1f5-463a-a2bf-d90c465b9066 response_code = 201 uri = /metrics/producers
23152024-11-14T17:02:18.875ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "37b50a33-c1f5-463a-a2bf-d90c465b9066", "content-length": "41", "date": "Thu, 14 Nov 2024 17:02:18 GMT"} })
23162024-11-14T17:02:18.876ZDEBGnexus (producer-registration-task): registered with nexus successfully
23172024-11-14T17:02:18.876ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
23182024-11-14T17:02:19.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fbb98bd6-8d1a-4c5c-a85c-8a287f027d7a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23192024-11-14T17:02:19.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fbb98bd6-8d1a-4c5c-a85c-8a287f027d7a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23202024-11-14T17:02:19.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fbb98bd6-8d1a-4c5c-a85c-8a287f027d7a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23212024-11-14T17:02:20.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ce70bde5-865d-423b-86c4-a7ff1a8f5c9a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23222024-11-14T17:02:20.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ce70bde5-865d-423b-86c4-a7ff1a8f5c9a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23232024-11-14T17:02:20.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ce70bde5-865d-423b-86c4-a7ff1a8f5c9a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23242024-11-14T17:02:21.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = db981de4-bbea-4c84-af79-b4dae6ef330c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23252024-11-14T17:02:21.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = db981de4-bbea-4c84-af79-b4dae6ef330c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23262024-11-14T17:02:21.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2702 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = db981de4-bbea-4c84-af79-b4dae6ef330c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23272024-11-14T17:02:22.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 367e547f-1341-4c51-9e0d-b4a30c745750 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23282024-11-14T17:02:22.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 367e547f-1341-4c51-9e0d-b4a30c745750 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23292024-11-14T17:02:22.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 367e547f-1341-4c51-9e0d-b4a30c745750 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23302024-11-14T17:02:23.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 897e551d-7f4e-4ed7-9746-219397b3fcf9 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23312024-11-14T17:02:23.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 897e551d-7f4e-4ed7-9746-219397b3fcf9 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23322024-11-14T17:02:23.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 897e551d-7f4e-4ed7-9746-219397b3fcf9 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23332024-11-14T17:02:24.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 72a472a4-3eec-4f95-9d93-4ec0f4dabfd6 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23342024-11-14T17:02:24.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 72a472a4-3eec-4f95-9d93-4ec0f4dabfd6 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23352024-11-14T17:02:24.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 72a472a4-3eec-4f95-9d93-4ec0f4dabfd6 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23362024-11-14T17:02:25.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6ebce09f-f6b7-457b-909e-aa90dbf1d8c3 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23372024-11-14T17:02:25.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6ebce09f-f6b7-457b-909e-aa90dbf1d8c3 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23382024-11-14T17:02:25.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6ebce09f-f6b7-457b-909e-aa90dbf1d8c3 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23392024-11-14T17:02:26.604ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1759 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = d742c499-507e-489e-a28b-ddade432cb8c response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
23402024-11-14T17:02:26.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
23412024-11-14T17:02:26.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23422024-11-14T17:02:26.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
23432024-11-14T17:02:26.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23442024-11-14T17:02:26.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23452024-11-14T17:02:26.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23462024-11-14T17:02:26.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23472024-11-14T17:02:26.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23482024-11-14T17:02:26.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23492024-11-14T17:02:26.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23502024-11-14T17:02:26.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23512024-11-14T17:02:26.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23522024-11-14T17:02:26.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23532024-11-14T17:02:26.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
23542024-11-14T17:02:26.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23552024-11-14T17:02:26.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23562024-11-14T17:02:26.731ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
23572024-11-14T17:02:26.731ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.321264ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
23582024-11-14T17:02:26.740ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23592024-11-14T17:02:26.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23602024-11-14T17:02:26.741ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.048436ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23612024-11-14T17:02:26.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c3e328db-686d-4fc5-bea1-23c6ae7aa3b7 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23622024-11-14T17:02:26.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c3e328db-686d-4fc5-bea1-23c6ae7aa3b7 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23632024-11-14T17:02:26.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c3e328db-686d-4fc5-bea1-23c6ae7aa3b7 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23642024-11-14T17:02:27.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 71d76254-87f8-4d62-96d6-4cf2903bb504 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23652024-11-14T17:02:27.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 71d76254-87f8-4d62-96d6-4cf2903bb504 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23662024-11-14T17:02:27.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1800 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 71d76254-87f8-4d62-96d6-4cf2903bb504 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23672024-11-14T17:02:28.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ff7da9d3-5724-4261-a26e-b464dcf5729f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23682024-11-14T17:02:28.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ff7da9d3-5724-4261-a26e-b464dcf5729f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23692024-11-14T17:02:28.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ff7da9d3-5724-4261-a26e-b464dcf5729f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23702024-11-14T17:02:29.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cb8efdd3-9c1f-4d5f-b991-08a01ecab291 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23712024-11-14T17:02:29.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cb8efdd3-9c1f-4d5f-b991-08a01ecab291 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23722024-11-14T17:02:29.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cb8efdd3-9c1f-4d5f-b991-08a01ecab291 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23732024-11-14T17:02:30.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 36396ac0-67b1-4a5e-ba5e-86c6dbc9c4bf roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23742024-11-14T17:02:30.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 36396ac0-67b1-4a5e-ba5e-86c6dbc9c4bf resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23752024-11-14T17:02:30.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 36396ac0-67b1-4a5e-ba5e-86c6dbc9c4bf response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23762024-11-14T17:02:31.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6b89a068-561d-49eb-8205-862d8cc5d7ec roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23772024-11-14T17:02:31.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6b89a068-561d-49eb-8205-862d8cc5d7ec resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23782024-11-14T17:02:31.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6b89a068-561d-49eb-8205-862d8cc5d7ec response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23792024-11-14T17:02:32.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b87e337d-17ba-4df1-8c99-b135c4b5efc0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23802024-11-14T17:02:32.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b87e337d-17ba-4df1-8c99-b135c4b5efc0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23812024-11-14T17:02:32.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b87e337d-17ba-4df1-8c99-b135c4b5efc0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23822024-11-14T17:02:33.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ee2aa522-ff0d-4412-9155-f49bd3547fb8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23832024-11-14T17:02:33.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ee2aa522-ff0d-4412-9155-f49bd3547fb8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23842024-11-14T17:02:33.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1736 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ee2aa522-ff0d-4412-9155-f49bd3547fb8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23852024-11-14T17:02:34.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9449acda-1810-440b-af10-af711a27f080 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23862024-11-14T17:02:34.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9449acda-1810-440b-af10-af711a27f080 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23872024-11-14T17:02:34.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9449acda-1810-440b-af10-af711a27f080 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23882024-11-14T17:02:36.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e775307f-e10e-492a-9823-a2bfcff16f74 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23892024-11-14T17:02:36.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e775307f-e10e-492a-9823-a2bfcff16f74 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23902024-11-14T17:02:36.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e775307f-e10e-492a-9823-a2bfcff16f74 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
23912024-11-14T17:02:36.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
23922024-11-14T17:02:36.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
23932024-11-14T17:02:36.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23942024-11-14T17:02:36.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23952024-11-14T17:02:36.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23962024-11-14T17:02:36.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23972024-11-14T17:02:36.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23982024-11-14T17:02:36.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23992024-11-14T17:02:36.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24002024-11-14T17:02:36.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24012024-11-14T17:02:36.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24022024-11-14T17:02:36.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24032024-11-14T17:02:36.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24042024-11-14T17:02:36.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
24052024-11-14T17:02:36.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24062024-11-14T17:02:36.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24072024-11-14T17:02:36.728ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
24082024-11-14T17:02:36.728ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.174933ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
24092024-11-14T17:02:36.736ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24102024-11-14T17:02:36.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24112024-11-14T17:02:36.738ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.461064ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24122024-11-14T17:02:37.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 09bbe8b4-45fd-4bd8-91aa-3f8cac2c80a0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24132024-11-14T17:02:37.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 09bbe8b4-45fd-4bd8-91aa-3f8cac2c80a0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24142024-11-14T17:02:37.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 09bbe8b4-45fd-4bd8-91aa-3f8cac2c80a0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24152024-11-14T17:02:38.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bbc30647-3c99-4fe1-b0c9-0cb967a3037d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24162024-11-14T17:02:38.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bbc30647-3c99-4fe1-b0c9-0cb967a3037d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24172024-11-14T17:02:38.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2591 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bbc30647-3c99-4fe1-b0c9-0cb967a3037d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24182024-11-14T17:02:39.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 37b367c8-9749-4262-b22f-0bda116312d2 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24192024-11-14T17:02:39.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 37b367c8-9749-4262-b22f-0bda116312d2 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24202024-11-14T17:02:39.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 37b367c8-9749-4262-b22f-0bda116312d2 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24212024-11-14T17:02:40.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b0cda1ae-5949-4bb8-bc00-ed5d943f4894 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24222024-11-14T17:02:40.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b0cda1ae-5949-4bb8-bc00-ed5d943f4894 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24232024-11-14T17:02:40.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b0cda1ae-5949-4bb8-bc00-ed5d943f4894 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24242024-11-14T17:02:41.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3ff0e251-9d9e-42f1-b13f-1d03bccc5bc3 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24252024-11-14T17:02:41.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3ff0e251-9d9e-42f1-b13f-1d03bccc5bc3 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24262024-11-14T17:02:41.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3ff0e251-9d9e-42f1-b13f-1d03bccc5bc3 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24272024-11-14T17:02:41.604ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1502 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 68dcee09-2e06-4ae2-9224-86df729fc873 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
24282024-11-14T17:02:42.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3aa09f43-c967-425e-b3d2-5f5b7282c99f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24292024-11-14T17:02:42.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3aa09f43-c967-425e-b3d2-5f5b7282c99f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24302024-11-14T17:02:42.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3aa09f43-c967-425e-b3d2-5f5b7282c99f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24312024-11-14T17:02:43.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = aa28c53b-1a31-436f-b57d-d50978c20654 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24322024-11-14T17:02:43.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = aa28c53b-1a31-436f-b57d-d50978c20654 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24332024-11-14T17:02:43.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = aa28c53b-1a31-436f-b57d-d50978c20654 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24342024-11-14T17:02:44.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d045f5ab-f7b6-4bfc-a61b-67947c8f7e9d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24352024-11-14T17:02:44.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d045f5ab-f7b6-4bfc-a61b-67947c8f7e9d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24362024-11-14T17:02:44.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d045f5ab-f7b6-4bfc-a61b-67947c8f7e9d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24372024-11-14T17:02:45.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 19ae2ce9-b978-44ad-991f-fea4fa9afe9a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24382024-11-14T17:02:45.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 19ae2ce9-b978-44ad-991f-fea4fa9afe9a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24392024-11-14T17:02:45.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1877 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 19ae2ce9-b978-44ad-991f-fea4fa9afe9a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24402024-11-14T17:02:46.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d371d35d-b2b4-4279-8ad8-0e8717a7cb2f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24412024-11-14T17:02:46.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d371d35d-b2b4-4279-8ad8-0e8717a7cb2f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24422024-11-14T17:02:46.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d371d35d-b2b4-4279-8ad8-0e8717a7cb2f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
24432024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
24442024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24452024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
24462024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
24472024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24482024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
24492024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24502024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24512024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
24522024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
24532024-11-14T17:02:46.708ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
24542024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24552024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24562024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
24572024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
24582024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24592024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
24602024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24612024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
24622024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
24632024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24642024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
24652024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
24662024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24672024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
24682024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24692024-11-14T17:02:46.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24702024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24712024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24722024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24732024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24742024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24752024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24762024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24772024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24782024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24792024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24802024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24812024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24822024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
24832024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
24842024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24852024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24862024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
24872024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24882024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
24892024-11-14T17:02:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24902024-11-14T17:02:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24912024-11-14T17:02:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24922024-11-14T17:02:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24932024-11-14T17:02:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24942024-11-14T17:02:46.711ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24952024-11-14T17:02:46.711ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.953886ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24962024-11-14T17:02:46.712ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2290, tv_nsec: 442212199 } })
24972024-11-14T17:02:46.712ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
24982024-11-14T17:02:46.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24992024-11-14T17:02:46.713ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25002024-11-14T17:02:46.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25012024-11-14T17:02:46.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25022024-11-14T17:02:46.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
25032024-11-14T17:02:46.714ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25042024-11-14T17:02:46.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25052024-11-14T17:02:46.716ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25062024-11-14T17:02:46.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25072024-11-14T17:02:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25082024-11-14T17:02:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25092024-11-14T17:02:46.716ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25102024-11-14T17:02:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25112024-11-14T17:02:46.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25122024-11-14T17:02:46.717ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2290, tv_nsec: 447214362 } })
25132024-11-14T17:02:46.717ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
25142024-11-14T17:02:46.718ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.810749ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
25152024-11-14T17:02:46.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25162024-11-14T17:02:46.720ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25172024-11-14T17:02:46.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25182024-11-14T17:02:46.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25192024-11-14T17:02:46.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25202024-11-14T17:02:46.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25212024-11-14T17:02:46.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25222024-11-14T17:02:46.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25232024-11-14T17:02:46.726ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2290, tv_nsec: 456188124 } })
25242024-11-14T17:02:46.726ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25252024-11-14T17:02:46.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25262024-11-14T17:02:46.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25272024-11-14T17:02:46.726ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
25282024-11-14T17:02:46.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25292024-11-14T17:02:46.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25302024-11-14T17:02:46.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25312024-11-14T17:02:46.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25322024-11-14T17:02:46.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.085471ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25332024-11-14T17:02:46.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25342024-11-14T17:02:46.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
25352024-11-14T17:02:46.769ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25362024-11-14T17:02:46.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25372024-11-14T17:02:46.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25382024-11-14T17:02:46.771ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25392024-11-14T17:02:46.771ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
25402024-11-14T17:02:46.771ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25412024-11-14T17:02:46.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25422024-11-14T17:02:46.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25432024-11-14T17:02:46.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
25442024-11-14T17:02:46.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25452024-11-14T17:02:46.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25462024-11-14T17:02:46.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25472024-11-14T17:02:46.776ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25482024-11-14T17:02:46.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25492024-11-14T17:02:46.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25502024-11-14T17:02:46.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25512024-11-14T17:02:46.779ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25522024-11-14T17:02:46.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25532024-11-14T17:02:46.779ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25542024-11-14T17:02:46.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25552024-11-14T17:02:46.780ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.754636ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
25562024-11-14T17:02:46.781ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.915295ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25572024-11-14T17:02:46.782ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25582024-11-14T17:02:46.783ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25592024-11-14T17:02:46.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25602024-11-14T17:02:46.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
25612024-11-14T17:02:46.786ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25622024-11-14T17:02:46.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25632024-11-14T17:02:46.789ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.457895ms iteration = 18 status = 0
25642024-11-14T17:02:46.804ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
25652024-11-14T17:02:46.804ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 95.393732ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
25662024-11-14T17:02:46.808ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
25672024-11-14T17:02:46.808ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25682024-11-14T17:02:46.809ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0db8266-9e7c-4c14-b901-3006c75d54f5", "content-length": "26", "date": "Thu, 14 Nov 2024 17:02:46 GMT"} })
25692024-11-14T17:02:46.809ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25702024-11-14T17:02:46.810ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25712024-11-14T17:02:46.816ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25722024-11-14T17:02:46.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25732024-11-14T17:02:46.819ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25742024-11-14T17:02:46.819ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 111.062535ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25752024-11-14T17:02:46.822ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25762024-11-14T17:02:46.822ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25772024-11-14T17:02:46.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25782024-11-14T17:02:46.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25792024-11-14T17:02:46.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25802024-11-14T17:02:46.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25812024-11-14T17:02:46.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25822024-11-14T17:02:46.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25832024-11-14T17:02:46.835ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
25842024-11-14T17:02:46.835ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25852024-11-14T17:02:46.835ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "567d5dd6-5a82-45c6-a871-e75f27edb553", "content-length": "26", "date": "Thu, 14 Nov 2024 17:02:46 GMT"} })
25862024-11-14T17:02:46.835ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25872024-11-14T17:02:46.836ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
25882024-11-14T17:02:46.836ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25892024-11-14T17:02:46.836ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "16d68764-1298-4e33-a5a1-8151b45af95e", "content-length": "26", "date": "Thu, 14 Nov 2024 17:02:46 GMT"} })
25902024-11-14T17:02:46.836ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25912024-11-14T17:02:46.837ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25922024-11-14T17:02:46.838ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
25932024-11-14T17:02:46.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 128.715564ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
25942024-11-14T17:02:46.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 156.116802ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
25952024-11-14T17:02:46.868ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25962024-11-14T17:02:46.868ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25972024-11-14T17:02:46.868ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 159.721893ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25982024-11-14T17:02:46.890ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25992024-11-14T17:02:46.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26002024-11-14T17:02:46.938ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26012024-11-14T17:02:46.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26022024-11-14T17:02:46.940ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26032024-11-14T17:02:46.940ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0e6ad80-1b26-4e9a-bb0d-b4b2f1af7671", "content-length": "1", "date": "Thu, 14 Nov 2024 17:02:46 GMT"} })
26042024-11-14T17:02:46.942ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26052024-11-14T17:02:46.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26062024-11-14T17:02:46.957ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26072024-11-14T17:02:46.957ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26082024-11-14T17:02:46.958ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a146a212-1651-40c0-abf5-85f51b9ea910", "content-length": "372", "date": "Thu, 14 Nov 2024 17:02:46 GMT"} })
26092024-11-14T17:02:46.958ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26102024-11-14T17:02:46.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26112024-11-14T17:02:46.960ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 251.795371ms iteration = 18 status = {}
26122024-11-14T17:02:46.961ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 252.862454ms iteration = 18 status = null
26132024-11-14T17:02:46.971ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 263.220469ms iteration = 21 status = {"physical_disks_added":0}
26142024-11-14T17:02:46.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26152024-11-14T17:02:47.002ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26162024-11-14T17:02:47.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26172024-11-14T17:02:47.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26182024-11-14T17:02:47.011ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
26192024-11-14T17:02:47.011ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26202024-11-14T17:02:47.011ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0b11003c-5c86-4f76-973e-3c0be2a80f29", "date": "Thu, 14 Nov 2024 17:02:46 GMT"} })
26212024-11-14T17:02:47.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26222024-11-14T17:02:47.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26232024-11-14T17:02:47.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26242024-11-14T17:02:47.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26252024-11-14T17:02:47.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26262024-11-14T17:02:47.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26272024-11-14T17:02:47.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = b3abbd56-4b5e-414b-a607-ef8ef94f97f6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
26282024-11-14T17:02:47.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = b3abbd56-4b5e-414b-a607-ef8ef94f97f6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
26292024-11-14T17:02:47.026ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26302024-11-14T17:02:47.026ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26312024-11-14T17:02:47.027ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "44dc057e-6b1d-4439-98b2-89799096fcda", "date": "Thu, 14 Nov 2024 17:02:46 GMT"} })
26322024-11-14T17:02:47.029ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 320.732357ms iteration = 19 status = {}
26332024-11-14T17:02:47.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3566 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = b3abbd56-4b5e-414b-a607-ef8ef94f97f6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
26342024-11-14T17:02:47.037ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26352024-11-14T17:02:47.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26362024-11-14T17:02:47.039ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26372024-11-14T17:02:47.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26382024-11-14T17:02:47.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26392024-11-14T17:02:47.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26402024-11-14T17:02:47.043ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
26412024-11-14T17:02:47.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26422024-11-14T17:02:47.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26432024-11-14T17:02:47.054ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26442024-11-14T17:02:47.054ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ad44e71-cc0d-432e-8281-13dbfbb1c70c", "content-length": "134", "date": "Thu, 14 Nov 2024 17:02:46 GMT"} })
26452024-11-14T17:02:47.054ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26462024-11-14T17:02:47.054ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
26472024-11-14T17:02:47.054ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26482024-11-14T17:02:47.054ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26492024-11-14T17:02:47.054ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26502024-11-14T17:02:47.054ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26512024-11-14T17:02:47.054ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26522024-11-14T17:02:47.054ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26532024-11-14T17:02:47.055ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26542024-11-14T17:02:47.055ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26552024-11-14T17:02:47.055ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
26562024-11-14T17:02:47.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26572024-11-14T17:02:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26582024-11-14T17:02:47.057ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26592024-11-14T17:02:47.057ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcb781a0-c65f-4e1c-adc5-af130ead8d01", "content-length": "2", "date": "Thu, 14 Nov 2024 17:02:46 GMT"} })
26602024-11-14T17:02:47.057ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26612024-11-14T17:02:47.057ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf23e98b-9037-4975-829a-82d4ac749373", "content-length": "52", "date": "Thu, 14 Nov 2024 17:02:46 GMT"} })
26622024-11-14T17:02:47.057ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
26632024-11-14T17:02:47.057ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26642024-11-14T17:02:47.073ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26652024-11-14T17:02:47.171ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4432c5d9-63c1-4a8f-85cb-aa68b6f09866", "date": "Thu, 14 Nov 2024 17:02:46 GMT"} })
26662024-11-14T17:02:47.171ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
26672024-11-14T17:02:47.171ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26682024-11-14T17:02:47.172ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "11bbd8cf-3d40-498d-a86f-a3bb0dd9f536", "content-length": "682", "date": "Thu, 14 Nov 2024 17:02:47 GMT"} })
26692024-11-14T17:02:47.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26702024-11-14T17:02:47.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26712024-11-14T17:02:47.172ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a27409d-2cb6-47b7-9b33-6b6c8c0efba8", "content-length": "691", "date": "Thu, 14 Nov 2024 17:02:46 GMT"} })
26722024-11-14T17:02:47.172ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
26732024-11-14T17:02:47.172ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
26742024-11-14T17:02:47.172ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
26752024-11-14T17:02:47.174ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 465.487113ms iteration = 18 status = {}
26762024-11-14T17:02:47.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26772024-11-14T17:02:47.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26782024-11-14T17:02:47.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26792024-11-14T17:02:47.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26802024-11-14T17:02:47.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26812024-11-14T17:02:47.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26822024-11-14T17:02:47.187ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 479.197252ms iteration = 18 status = {}
26832024-11-14T17:02:47.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77cc55-798e-44c6-a517-80efc5496b73 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
26842024-11-14T17:02:47.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77cc55-798e-44c6-a517-80efc5496b73 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
26852024-11-14T17:02:47.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77cc55-798e-44c6-a517-80efc5496b73 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
26862024-11-14T17:02:48.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7b8003e1-7c32-4a63-a5a6-c41f88f91e89 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
26872024-11-14T17:02:48.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7b8003e1-7c32-4a63-a5a6-c41f88f91e89 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
26882024-11-14T17:02:48.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7b8003e1-7c32-4a63-a5a6-c41f88f91e89 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
26892024-11-14T17:02:49.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0925e310-2004-487a-94be-0ebc57cab5b7 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
26902024-11-14T17:02:49.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0925e310-2004-487a-94be-0ebc57cab5b7 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
26912024-11-14T17:02:49.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0925e310-2004-487a-94be-0ebc57cab5b7 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
26922024-11-14T17:02:50.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a285e31f-fa21-4371-96cf-8a3c29bf97e1 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
26932024-11-14T17:02:50.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a285e31f-fa21-4371-96cf-8a3c29bf97e1 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
26942024-11-14T17:02:50.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a285e31f-fa21-4371-96cf-8a3c29bf97e1 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
26952024-11-14T17:02:51.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 295ec614-e36e-4026-8f38-15a0fd586834 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
26962024-11-14T17:02:51.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 295ec614-e36e-4026-8f38-15a0fd586834 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
26972024-11-14T17:02:51.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 295ec614-e36e-4026-8f38-15a0fd586834 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
26982024-11-14T17:02:52.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ab11c7f0-e32f-4add-b11c-a1ae3207181b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
26992024-11-14T17:02:52.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ab11c7f0-e32f-4add-b11c-a1ae3207181b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27002024-11-14T17:02:52.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ab11c7f0-e32f-4add-b11c-a1ae3207181b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27012024-11-14T17:02:53.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 52378e81-4636-4ec8-a767-7dc4ef71bd98 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27022024-11-14T17:02:53.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 52378e81-4636-4ec8-a767-7dc4ef71bd98 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27032024-11-14T17:02:53.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 52378e81-4636-4ec8-a767-7dc4ef71bd98 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27042024-11-14T17:02:54.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a48f1084-bdee-4a9f-b423-6113014bd070 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27052024-11-14T17:02:54.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a48f1084-bdee-4a9f-b423-6113014bd070 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27062024-11-14T17:02:54.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a48f1084-bdee-4a9f-b423-6113014bd070 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27072024-11-14T17:02:55.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c5a277a4-a584-4ca3-9166-6971d938bd7e roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27082024-11-14T17:02:55.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c5a277a4-a584-4ca3-9166-6971d938bd7e resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27092024-11-14T17:02:55.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c5a277a4-a584-4ca3-9166-6971d938bd7e response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27102024-11-14T17:02:56.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bd49b44a-e555-4c4d-81f6-ed785db159af roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27112024-11-14T17:02:56.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bd49b44a-e555-4c4d-81f6-ed785db159af resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27122024-11-14T17:02:56.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bd49b44a-e555-4c4d-81f6-ed785db159af response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27132024-11-14T17:02:56.603ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1337 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 8fb6e48e-d6d7-4249-94b3-52937a8d5011 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
27142024-11-14T17:02:56.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
27152024-11-14T17:02:56.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
27162024-11-14T17:02:56.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27172024-11-14T17:02:56.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27182024-11-14T17:02:56.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27192024-11-14T17:02:56.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27202024-11-14T17:02:56.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27212024-11-14T17:02:56.744ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27222024-11-14T17:02:56.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27232024-11-14T17:02:56.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27242024-11-14T17:02:56.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27252024-11-14T17:02:56.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27262024-11-14T17:02:56.746ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.830454ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27272024-11-14T17:02:56.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27282024-11-14T17:02:56.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27292024-11-14T17:02:56.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27302024-11-14T17:02:56.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
27312024-11-14T17:02:56.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27322024-11-14T17:02:56.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27332024-11-14T17:02:56.801ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
27342024-11-14T17:02:56.802ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.05272ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
27352024-11-14T17:02:57.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c933baf5-80d1-4258-97d4-71b0f836e9e4 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27362024-11-14T17:02:57.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c933baf5-80d1-4258-97d4-71b0f836e9e4 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27372024-11-14T17:02:57.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c933baf5-80d1-4258-97d4-71b0f836e9e4 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27382024-11-14T17:02:58.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5883b39e-3dd9-49e1-a482-a8e6e6142c43 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27392024-11-14T17:02:58.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5883b39e-3dd9-49e1-a482-a8e6e6142c43 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27402024-11-14T17:02:58.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5883b39e-3dd9-49e1-a482-a8e6e6142c43 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27412024-11-14T17:02:59.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 192e7d79-bfc9-448b-9344-6db074b9667f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27422024-11-14T17:02:59.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 192e7d79-bfc9-448b-9344-6db074b9667f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27432024-11-14T17:02:59.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2552 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 192e7d79-bfc9-448b-9344-6db074b9667f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27442024-11-14T17:03:00.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6aa04973-0527-4f31-b605-eafbaf6a08eb roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27452024-11-14T17:03:00.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6aa04973-0527-4f31-b605-eafbaf6a08eb resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27462024-11-14T17:03:00.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6aa04973-0527-4f31-b605-eafbaf6a08eb response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27472024-11-14T17:03:01.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 190f126a-2bcf-4d67-8e62-6a506b81f7d4 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27482024-11-14T17:03:01.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 190f126a-2bcf-4d67-8e62-6a506b81f7d4 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27492024-11-14T17:03:01.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 190f126a-2bcf-4d67-8e62-6a506b81f7d4 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27502024-11-14T17:03:02.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = add59d8d-46a1-4d7b-bf19-65567df1bd14 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27512024-11-14T17:03:02.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = add59d8d-46a1-4d7b-bf19-65567df1bd14 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27522024-11-14T17:03:02.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = add59d8d-46a1-4d7b-bf19-65567df1bd14 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27532024-11-14T17:03:03.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 94247aa5-2f10-44f8-a383-8d963b4ada47 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27542024-11-14T17:03:03.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 94247aa5-2f10-44f8-a383-8d963b4ada47 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27552024-11-14T17:03:03.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 94247aa5-2f10-44f8-a383-8d963b4ada47 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27562024-11-14T17:03:04.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 52b5e186-9792-4619-a9bf-872b45e52535 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27572024-11-14T17:03:04.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 52b5e186-9792-4619-a9bf-872b45e52535 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27582024-11-14T17:03:04.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 52b5e186-9792-4619-a9bf-872b45e52535 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27592024-11-14T17:03:05.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6fad6c77-7d7a-49ef-a332-25f48c73a860 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27602024-11-14T17:03:05.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6fad6c77-7d7a-49ef-a332-25f48c73a860 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27612024-11-14T17:03:05.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2673 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6fad6c77-7d7a-49ef-a332-25f48c73a860 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27622024-11-14T17:03:06.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
27632024-11-14T17:03:06.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
27642024-11-14T17:03:06.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27652024-11-14T17:03:06.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27662024-11-14T17:03:06.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27672024-11-14T17:03:06.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27682024-11-14T17:03:06.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27692024-11-14T17:03:06.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27702024-11-14T17:03:06.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27712024-11-14T17:03:06.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27722024-11-14T17:03:06.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27732024-11-14T17:03:06.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27742024-11-14T17:03:06.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27752024-11-14T17:03:06.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2df25a35-2c31-4c2e-900f-a3631aad41da roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27762024-11-14T17:03:06.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2df25a35-2c31-4c2e-900f-a3631aad41da resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27772024-11-14T17:03:06.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2df25a35-2c31-4c2e-900f-a3631aad41da response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27782024-11-14T17:03:06.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
27792024-11-14T17:03:06.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27802024-11-14T17:03:06.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27812024-11-14T17:03:06.731ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
27822024-11-14T17:03:06.731ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.220973ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
27832024-11-14T17:03:06.740ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27842024-11-14T17:03:06.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27852024-11-14T17:03:06.742ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.559517ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27862024-11-14T17:03:07.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 14af41d2-ad8d-47bb-8df2-dc7ff7d5a141 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27872024-11-14T17:03:07.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 14af41d2-ad8d-47bb-8df2-dc7ff7d5a141 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27882024-11-14T17:03:07.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 14af41d2-ad8d-47bb-8df2-dc7ff7d5a141 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27892024-11-14T17:03:08.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0765d906-79fe-4df1-8b38-5b284e6b152a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27902024-11-14T17:03:08.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0765d906-79fe-4df1-8b38-5b284e6b152a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27912024-11-14T17:03:08.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0765d906-79fe-4df1-8b38-5b284e6b152a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27922024-11-14T17:03:09.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 33e1a6e4-a599-4c98-ac5b-0d1e3a3e24e7 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27932024-11-14T17:03:09.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 33e1a6e4-a599-4c98-ac5b-0d1e3a3e24e7 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27942024-11-14T17:03:09.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 33e1a6e4-a599-4c98-ac5b-0d1e3a3e24e7 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27952024-11-14T17:03:10.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d239d795-58ff-4f6e-beb4-fcc57f48efda roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27962024-11-14T17:03:10.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d239d795-58ff-4f6e-beb4-fcc57f48efda resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27972024-11-14T17:03:10.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d239d795-58ff-4f6e-beb4-fcc57f48efda response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
27982024-11-14T17:03:11.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1604 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 98eac018-2060-410b-ae4b-755e554950b4 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
27992024-11-14T17:03:11.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1ab10955-828e-4beb-8b9c-cd5008103bc5 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
28002024-11-14T17:03:11.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1ab10955-828e-4beb-8b9c-cd5008103bc5 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
28012024-11-14T17:03:11.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1ab10955-828e-4beb-8b9c-cd5008103bc5 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
28022024-11-14T17:03:12.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = db4ec606-1bf4-4ff2-a034-c52b5c56f617 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
28032024-11-14T17:03:12.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = db4ec606-1bf4-4ff2-a034-c52b5c56f617 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
28042024-11-14T17:03:12.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = db4ec606-1bf4-4ff2-a034-c52b5c56f617 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
28052024-11-14T17:03:13.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 71459f96-bfa5-412c-b46c-16de08e4d81f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
28062024-11-14T17:03:13.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 71459f96-bfa5-412c-b46c-16de08e4d81f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
28072024-11-14T17:03:13.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 71459f96-bfa5-412c-b46c-16de08e4d81f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
28082024-11-14T17:03:14.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ef882b24-d60f-417a-88dc-6664408d936c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
28092024-11-14T17:03:14.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ef882b24-d60f-417a-88dc-6664408d936c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
28102024-11-14T17:03:14.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ef882b24-d60f-417a-88dc-6664408d936c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
28112024-11-14T17:03:15.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 30d52931-93ce-4539-b8a5-41d0692b3a2c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
28122024-11-14T17:03:15.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 30d52931-93ce-4539-b8a5-41d0692b3a2c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
28132024-11-14T17:03:15.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 30d52931-93ce-4539-b8a5-41d0692b3a2c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
28142024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
28152024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28162024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
28172024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
28182024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28192024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
28202024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
28212024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
28222024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28232024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28242024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
28252024-11-14T17:03:16.708ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28262024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28272024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
28282024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
28292024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
28302024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
28312024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28322024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28332024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
28342024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
28352024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28362024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
28372024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
28382024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28392024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28402024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28412024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
28422024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
28432024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28442024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
28452024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
28462024-11-14T17:03:16.708ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 16:53:16.708807924 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
28472024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
28482024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
28492024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
28502024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
28512024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
28522024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28532024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
28542024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
28552024-11-14T17:03:16.708ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
28562024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
28572024-11-14T17:03:16.708ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
28582024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28592024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
28602024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28612024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
28622024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
28632024-11-14T17:03:16.709ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5
28642024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28652024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.701\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5"}
28662024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28672024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28682024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28692024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28702024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28712024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28722024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28732024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
28742024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28752024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28762024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28772024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28782024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
28792024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28802024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
28812024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28822024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28832024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
28842024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
28852024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
28862024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
28872024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
28882024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28892024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
28902024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
28912024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
28922024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28932024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28942024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
28952024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
28962024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28972024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28982024-11-14T17:03:16.709ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94482e71-9503-4d09-b73f-615fbf343a2e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2320, tv_nsec: 439256414 } })
28992024-11-14T17:03:16.709ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89b01be2-c37f-445d-addd-6b4be9cd73c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc5fdca1-6d92-4ff4-b5ae-2f44553a2186.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2320, tv_nsec: 439256894 } })
29002024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
29012024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29022024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29032024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29042024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29052024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
29062024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29072024-11-14T17:03:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29082024-11-14T17:03:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29092024-11-14T17:03:16.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29102024-11-14T17:03:16.710ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
29112024-11-14T17:03:16.710ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.254978ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
29122024-11-14T17:03:16.710ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
29132024-11-14T17:03:16.710ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.29491ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
29142024-11-14T17:03:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29152024-11-14T17:03:16.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29162024-11-14T17:03:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29172024-11-14T17:03:16.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29182024-11-14T17:03:16.711ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29192024-11-14T17:03:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29202024-11-14T17:03:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29212024-11-14T17:03:16.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29222024-11-14T17:03:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29232024-11-14T17:03:16.713ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.561153ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29242024-11-14T17:03:16.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29252024-11-14T17:03:16.715ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29262024-11-14T17:03:16.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29272024-11-14T17:03:16.717ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29282024-11-14T17:03:16.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29292024-11-14T17:03:16.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29302024-11-14T17:03:16.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29312024-11-14T17:03:16.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29322024-11-14T17:03:16.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29332024-11-14T17:03:16.722ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 16:53:16.708807924 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
29342024-11-14T17:03:16.722ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.777681ms iteration = 10 status = {"expiration":"2024-11-14T16:53:16.708807924Z","pruned":[]}
29352024-11-14T17:03:16.723ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2320, tv_nsec: 452962624 } })
29362024-11-14T17:03:16.723ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
29372024-11-14T17:03:16.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29382024-11-14T17:03:16.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29392024-11-14T17:03:16.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29402024-11-14T17:03:16.728ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29412024-11-14T17:03:16.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29422024-11-14T17:03:16.731ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29432024-11-14T17:03:16.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29442024-11-14T17:03:16.733ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2320, tv_nsec: 463205025 } })
29452024-11-14T17:03:16.734ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
29462024-11-14T17:03:16.735ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.69985ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
29472024-11-14T17:03:16.786ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29482024-11-14T17:03:16.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29492024-11-14T17:03:16.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29502024-11-14T17:03:16.789ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29512024-11-14T17:03:16.792ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29522024-11-14T17:03:16.793ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
29532024-11-14T17:03:16.793ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29542024-11-14T17:03:16.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29552024-11-14T17:03:16.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29562024-11-14T17:03:16.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
29572024-11-14T17:03:16.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
29582024-11-14T17:03:16.797ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29592024-11-14T17:03:16.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29602024-11-14T17:03:16.797ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29612024-11-14T17:03:16.797ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29622024-11-14T17:03:16.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29632024-11-14T17:03:16.798ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29642024-11-14T17:03:16.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29652024-11-14T17:03:16.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29662024-11-14T17:03:16.798ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29672024-11-14T17:03:16.798ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29682024-11-14T17:03:16.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29692024-11-14T17:03:16.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29702024-11-14T17:03:16.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29712024-11-14T17:03:16.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29722024-11-14T17:03:16.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 90.933481ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
29732024-11-14T17:03:16.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29742024-11-14T17:03:16.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
29752024-11-14T17:03:16.801ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29762024-11-14T17:03:16.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29772024-11-14T17:03:16.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 92.875965ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
29782024-11-14T17:03:16.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
29792024-11-14T17:03:16.802ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29802024-11-14T17:03:16.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29812024-11-14T17:03:16.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29822024-11-14T17:03:16.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29832024-11-14T17:03:16.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29842024-11-14T17:03:16.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29852024-11-14T17:03:16.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29862024-11-14T17:03:16.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29872024-11-14T17:03:16.805ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29882024-11-14T17:03:16.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29892024-11-14T17:03:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29902024-11-14T17:03:16.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
29912024-11-14T17:03:16.809ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29922024-11-14T17:03:16.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29932024-11-14T17:03:16.813ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29942024-11-14T17:03:16.813ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29952024-11-14T17:03:16.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29962024-11-14T17:03:16.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29972024-11-14T17:03:16.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29982024-11-14T17:03:16.815ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29992024-11-14T17:03:16.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30002024-11-14T17:03:16.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30012024-11-14T17:03:16.816ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30022024-11-14T17:03:16.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30032024-11-14T17:03:16.817ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30042024-11-14T17:03:16.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30052024-11-14T17:03:16.818ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
30062024-11-14T17:03:16.818ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
30072024-11-14T17:03:16.818ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 108.788195ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
30082024-11-14T17:03:16.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30092024-11-14T17:03:16.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30102024-11-14T17:03:16.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30112024-11-14T17:03:16.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30122024-11-14T17:03:16.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
30132024-11-14T17:03:16.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30142024-11-14T17:03:16.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30152024-11-14T17:03:16.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30162024-11-14T17:03:16.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30172024-11-14T17:03:16.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30182024-11-14T17:03:16.825ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2320, tv_nsec: 555073817 } })
30192024-11-14T17:03:16.825ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
30202024-11-14T17:03:16.826ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30212024-11-14T17:03:16.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
30222024-11-14T17:03:16.830ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30232024-11-14T17:03:16.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30242024-11-14T17:03:16.845ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 136.485679ms iteration = 5 status = {"nsuccess":5}
30252024-11-14T17:03:16.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
30262024-11-14T17:03:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
30272024-11-14T17:03:16.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 153.144656ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30282024-11-14T17:03:16.863ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
30292024-11-14T17:03:16.863ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
30302024-11-14T17:03:16.863ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
30312024-11-14T17:03:16.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30322024-11-14T17:03:16.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30332024-11-14T17:03:16.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30342024-11-14T17:03:16.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30352024-11-14T17:03:16.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30362024-11-14T17:03:16.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30372024-11-14T17:03:16.871ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30382024-11-14T17:03:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30392024-11-14T17:03:16.875ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30402024-11-14T17:03:16.875ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 166.768643ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30412024-11-14T17:03:16.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 169.115685ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30422024-11-14T17:03:16.879ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
30432024-11-14T17:03:16.879ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30442024-11-14T17:03:16.880ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4800f40-522c-43ea-a2f7-c124e9ebc018", "content-length": "26", "date": "Thu, 14 Nov 2024 17:03:16 GMT"} })
30452024-11-14T17:03:16.880ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30462024-11-14T17:03:16.881ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
30472024-11-14T17:03:16.881ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 172.375069ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
30482024-11-14T17:03:16.884ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30492024-11-14T17:03:16.885ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
30502024-11-14T17:03:16.885ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
30512024-11-14T17:03:16.885ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
30522024-11-14T17:03:16.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30532024-11-14T17:03:16.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30542024-11-14T17:03:16.888ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30552024-11-14T17:03:16.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 178.748183ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30562024-11-14T17:03:16.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30572024-11-14T17:03:16.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30582024-11-14T17:03:16.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30592024-11-14T17:03:16.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30602024-11-14T17:03:16.892ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
30612024-11-14T17:03:16.892ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
30622024-11-14T17:03:16.892ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 183.661713ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
30632024-11-14T17:03:16.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30642024-11-14T17:03:16.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30652024-11-14T17:03:16.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30662024-11-14T17:03:16.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30672024-11-14T17:03:16.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30682024-11-14T17:03:16.893ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30692024-11-14T17:03:16.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30702024-11-14T17:03:16.893ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30712024-11-14T17:03:16.893ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30722024-11-14T17:03:16.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30732024-11-14T17:03:16.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30742024-11-14T17:03:16.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30752024-11-14T17:03:16.896ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30762024-11-14T17:03:16.896ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
30772024-11-14T17:03:16.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30782024-11-14T17:03:16.896ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
30792024-11-14T17:03:16.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30802024-11-14T17:03:16.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30812024-11-14T17:03:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
30822024-11-14T17:03:16.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30832024-11-14T17:03:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30842024-11-14T17:03:16.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30852024-11-14T17:03:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30862024-11-14T17:03:16.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30872024-11-14T17:03:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30882024-11-14T17:03:16.915ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 206.624722ms iteration = 19 status = 0
30892024-11-14T17:03:16.925ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
30902024-11-14T17:03:16.925ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
30912024-11-14T17:03:16.925ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 16:54:46.198050 UTC dns_group = internal generation = 1
30922024-11-14T17:03:16.925ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 217.280592ms iteration = 11 status = {"generation":1}
30932024-11-14T17:03:16.930ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30942024-11-14T17:03:16.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30952024-11-14T17:03:16.937ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30962024-11-14T17:03:16.941ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
30972024-11-14T17:03:16.941ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30982024-11-14T17:03:16.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30992024-11-14T17:03:16.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5143dfe7-b63f-45d9-8a92-46ddf482b17c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
31002024-11-14T17:03:16.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5143dfe7-b63f-45d9-8a92-46ddf482b17c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
31012024-11-14T17:03:16.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5143dfe7-b63f-45d9-8a92-46ddf482b17c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
31022024-11-14T17:03:16.956ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
31032024-11-14T17:03:16.956ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 0 version = 2
31042024-11-14T17:03:16.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31052024-11-14T17:03:16.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31062024-11-14T17:03:16.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31072024-11-14T17:03:16.960ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T16:54:14.392760Z, time_modified: 2024-11-14T16:54:14.392760Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }) }
31082024-11-14T17:03:16.960ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 251.71939ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]}},"default_endpoint":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
31092024-11-14T17:03:16.961ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
31102024-11-14T17:03:16.961ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31112024-11-14T17:03:16.961ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a885163d-6a5a-4106-9188-bcff273a016f", "content-length": "26", "date": "Thu, 14 Nov 2024 17:03:16 GMT"} })
31122024-11-14T17:03:16.962ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31132024-11-14T17:03:16.965ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31142024-11-14T17:03:16.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31152024-11-14T17:03:16.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31162024-11-14T17:03:16.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31172024-11-14T17:03:16.967ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31182024-11-14T17:03:16.967ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
31192024-11-14T17:03:16.967ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 258.476481ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
31202024-11-14T17:03:16.968ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 1 version = 2
31212024-11-14T17:03:16.968ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
31222024-11-14T17:03:16.968ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 16:54:47.468912 UTC dns_group = external generation = 2
31232024-11-14T17:03:16.968ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 260.089668ms iteration = 11 status = {"generation":2}
31242024-11-14T17:03:16.985ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 275.68168ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
31252024-11-14T17:03:16.990ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
31262024-11-14T17:03:17.007ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
31272024-11-14T17:03:17.007ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31282024-11-14T17:03:17.007ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cef27677-3701-417d-9531-f376f05a7af4", "content-length": "26", "date": "Thu, 14 Nov 2024 17:03:16 GMT"} })
31292024-11-14T17:03:17.008ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31302024-11-14T17:03:17.010ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
31312024-11-14T17:03:17.051ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
31322024-11-14T17:03:17.051ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 342.506388ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
31332024-11-14T17:03:17.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31342024-11-14T17:03:17.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31352024-11-14T17:03:17.061ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31362024-11-14T17:03:17.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 261fb89a-77ce-4cba-bc7c-b71195bca317 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
31372024-11-14T17:03:17.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 261fb89a-77ce-4cba-bc7c-b71195bca317 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
31382024-11-14T17:03:17.064ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31392024-11-14T17:03:17.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31402024-11-14T17:03:17.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31412024-11-14T17:03:17.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 261fb89a-77ce-4cba-bc7c-b71195bca317 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
31422024-11-14T17:03:17.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31432024-11-14T17:03:17.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31442024-11-14T17:03:17.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31452024-11-14T17:03:17.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31462024-11-14T17:03:17.079ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 370.99713ms iteration = 22 status = {"physical_disks_added":0}
31472024-11-14T17:03:17.101ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
31482024-11-14T17:03:17.170ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
31492024-11-14T17:03:17.170ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31502024-11-14T17:03:17.170ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f78e2140-bc84-4530-b54f-78855fe724d7", "content-length": "372", "date": "Thu, 14 Nov 2024 17:03:17 GMT"} })
31512024-11-14T17:03:17.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31522024-11-14T17:03:17.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31532024-11-14T17:03:17.182ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 473.529024ms iteration = 19 status = {}
31542024-11-14T17:03:17.202ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31552024-11-14T17:03:17.202ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a2d0aa9-e2f7-4fb1-bece-7dab56d74505", "content-length": "1", "date": "Thu, 14 Nov 2024 17:03:16 GMT"} })
31562024-11-14T17:03:17.205ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31572024-11-14T17:03:17.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31582024-11-14T17:03:17.208ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 499.044309ms iteration = 19 status = null
31592024-11-14T17:03:17.238ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
31602024-11-14T17:03:17.238ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
31612024-11-14T17:03:17.238ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b5b6e35b-2c2c-4211-9dd3-b5cf32fd8be2", "date": "Thu, 14 Nov 2024 17:03:17 GMT"} })
31622024-11-14T17:03:17.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31632024-11-14T17:03:17.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31642024-11-14T17:03:17.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31652024-11-14T17:03:17.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31662024-11-14T17:03:17.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31672024-11-14T17:03:17.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31682024-11-14T17:03:17.261ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31692024-11-14T17:03:17.262ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9dec1d3-f995-4df4-abf8-4374a26c18f0", "content-length": "691", "date": "Thu, 14 Nov 2024 17:03:17 GMT"} })
31702024-11-14T17:03:17.262ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
31712024-11-14T17:03:17.262ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
31722024-11-14T17:03:17.262ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
31732024-11-14T17:03:17.264ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 556.167668ms iteration = 19 status = {}
31742024-11-14T17:03:17.265ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
31752024-11-14T17:03:17.265ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31762024-11-14T17:03:17.266ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dbb74453-7314-4623-bfd9-e6efd17c5ec2", "date": "Thu, 14 Nov 2024 17:03:17 GMT"} })
31772024-11-14T17:03:17.268ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 559.522874ms iteration = 20 status = {}
31782024-11-14T17:03:17.307ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
31792024-11-14T17:03:17.334ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
31802024-11-14T17:03:17.334ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6c036c50-2ad6-494e-8763-d7f4c28d6f11", "date": "Thu, 14 Nov 2024 17:03:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31812024-11-14T17:03:17.334ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31822024-11-14T17:03:17.337ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "59a67719-f8fa-4110-bf8e-c69300bb2ad1", "date": "Thu, 14 Nov 2024 17:03:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31832024-11-14T17:03:17.337ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31842024-11-14T17:03:17.339ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31852024-11-14T17:03:17.339ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 630.340242ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
31862024-11-14T17:03:17.388ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
31872024-11-14T17:03:17.389ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "32336173-6e83-4427-937a-e7a8cbe221bb", "date": "Thu, 14 Nov 2024 17:03:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
31882024-11-14T17:03:17.389ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
31892024-11-14T17:03:17.390ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b5e7caa6-4c81-41f2-a8b9-249cc449d564", "date": "Thu, 14 Nov 2024 17:03:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
31902024-11-14T17:03:17.390ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
31912024-11-14T17:03:17.393ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "52237b83-7a4b-4906-a671-26ddca969b22", "date": "Thu, 14 Nov 2024 17:03:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
31922024-11-14T17:03:17.393ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
31932024-11-14T17:03:17.396ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
31942024-11-14T17:03:17.396ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 687.362498ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
31952024-11-14T17:03:17.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31962024-11-14T17:03:17.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31972024-11-14T17:03:17.409ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
31982024-11-14T17:03:17.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31992024-11-14T17:03:17.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32002024-11-14T17:03:17.422ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32012024-11-14T17:03:17.423ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2001b61d-ac24-4c52-8bfb-7b96c232f1e1", "content-length": "134", "date": "Thu, 14 Nov 2024 17:03:16 GMT"} })
32022024-11-14T17:03:17.423ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
32032024-11-14T17:03:17.423ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
32042024-11-14T17:03:17.423ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
32052024-11-14T17:03:17.423ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32062024-11-14T17:03:17.423ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32072024-11-14T17:03:17.423ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32082024-11-14T17:03:17.423ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32092024-11-14T17:03:17.423ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32102024-11-14T17:03:17.423ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32112024-11-14T17:03:17.423ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32122024-11-14T17:03:17.423ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
32132024-11-14T17:03:17.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32142024-11-14T17:03:17.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32152024-11-14T17:03:17.425ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32162024-11-14T17:03:17.426ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "47e4fd56-29bf-4d5e-8cca-6f15dab6c82c", "content-length": "2", "date": "Thu, 14 Nov 2024 17:03:16 GMT"} })
32172024-11-14T17:03:17.426ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32182024-11-14T17:03:17.426ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9f8046a-d34d-481a-bcbd-7c37ac10913a", "content-length": "52", "date": "Thu, 14 Nov 2024 17:03:16 GMT"} })
32192024-11-14T17:03:17.426ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
32202024-11-14T17:03:17.426ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32212024-11-14T17:03:17.789ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "36699820-1531-46fa-8fa3-863caf085b43", "date": "Thu, 14 Nov 2024 17:03:17 GMT"} })
32222024-11-14T17:03:17.789ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
32232024-11-14T17:03:17.789ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32242024-11-14T17:03:17.790ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcdb63bb-b58d-4b98-b5e4-419d51d737ad", "content-length": "682", "date": "Thu, 14 Nov 2024 17:03:17 GMT"} })
32252024-11-14T17:03:17.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32262024-11-14T17:03:17.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32272024-11-14T17:03:17.794ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32282024-11-14T17:03:17.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32292024-11-14T17:03:17.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32302024-11-14T17:03:17.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32312024-11-14T17:03:17.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32322024-11-14T17:03:17.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32332024-11-14T17:03:17.807ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 1.098637938s iteration = 19 status = {}
32342024-11-14T17:03:17.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a23388d6-0431-4651-a5f3-59eb3c1791cd roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32352024-11-14T17:03:17.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a23388d6-0431-4651-a5f3-59eb3c1791cd resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32362024-11-14T17:03:17.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a23388d6-0431-4651-a5f3-59eb3c1791cd response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32372024-11-14T17:03:19.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d201a563-4c56-4d8f-b7f9-599d45b0d168 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32382024-11-14T17:03:19.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d201a563-4c56-4d8f-b7f9-599d45b0d168 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32392024-11-14T17:03:19.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1844 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d201a563-4c56-4d8f-b7f9-599d45b0d168 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32402024-11-14T17:03:20.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0b66cd7b-f03c-4ef0-ad23-7455f9033a1c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32412024-11-14T17:03:20.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0b66cd7b-f03c-4ef0-ad23-7455f9033a1c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32422024-11-14T17:03:20.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0b66cd7b-f03c-4ef0-ad23-7455f9033a1c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32432024-11-14T17:03:21.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 14bcfcb0-a0ce-4056-accd-a2b7a7bcc6c1 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32442024-11-14T17:03:21.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 14bcfcb0-a0ce-4056-accd-a2b7a7bcc6c1 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32452024-11-14T17:03:21.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 14bcfcb0-a0ce-4056-accd-a2b7a7bcc6c1 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32462024-11-14T17:03:22.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 96913a9e-8b6d-49e5-bb3d-6ec469d93481 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32472024-11-14T17:03:22.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 96913a9e-8b6d-49e5-bb3d-6ec469d93481 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32482024-11-14T17:03:22.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 96913a9e-8b6d-49e5-bb3d-6ec469d93481 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32492024-11-14T17:03:23.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 10020719-905c-405e-8b39-b9f658b2b8fa roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32502024-11-14T17:03:23.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 10020719-905c-405e-8b39-b9f658b2b8fa resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32512024-11-14T17:03:23.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 10020719-905c-405e-8b39-b9f658b2b8fa response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32522024-11-14T17:03:24.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6348b7b7-d785-4c30-9c6a-ce31190630ec roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32532024-11-14T17:03:24.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6348b7b7-d785-4c30-9c6a-ce31190630ec resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32542024-11-14T17:03:24.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2683 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6348b7b7-d785-4c30-9c6a-ce31190630ec response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32552024-11-14T17:03:25.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b4a6c34c-129d-42c5-b68a-078404a7c78e roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32562024-11-14T17:03:25.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b4a6c34c-129d-42c5-b68a-078404a7c78e resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32572024-11-14T17:03:25.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2629 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b4a6c34c-129d-42c5-b68a-078404a7c78e response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32582024-11-14T17:03:26.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 92e2f3b9-3996-4d6d-96d9-ed07b66b0fc2 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32592024-11-14T17:03:26.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 92e2f3b9-3996-4d6d-96d9-ed07b66b0fc2 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32602024-11-14T17:03:26.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 92e2f3b9-3996-4d6d-96d9-ed07b66b0fc2 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32612024-11-14T17:03:26.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1761 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 715101c2-2dc5-4146-a93f-f94b93d367e3 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
32622024-11-14T17:03:26.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
32632024-11-14T17:03:26.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32642024-11-14T17:03:26.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
32652024-11-14T17:03:26.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32662024-11-14T17:03:26.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32672024-11-14T17:03:26.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32682024-11-14T17:03:26.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32692024-11-14T17:03:26.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32702024-11-14T17:03:26.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32712024-11-14T17:03:26.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.477838ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32722024-11-14T17:03:26.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32732024-11-14T17:03:26.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32742024-11-14T17:03:26.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32752024-11-14T17:03:26.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32762024-11-14T17:03:26.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32772024-11-14T17:03:26.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32782024-11-14T17:03:26.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
32792024-11-14T17:03:26.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32802024-11-14T17:03:26.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32812024-11-14T17:03:26.725ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
32822024-11-14T17:03:26.725ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.29644ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
32832024-11-14T17:03:27.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7d174ffc-5865-479d-bc6b-bbb05b359906 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32842024-11-14T17:03:27.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7d174ffc-5865-479d-bc6b-bbb05b359906 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32852024-11-14T17:03:27.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7d174ffc-5865-479d-bc6b-bbb05b359906 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32862024-11-14T17:03:28.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a9e85db6-14b5-4c14-bb52-19ee661a56d4 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32872024-11-14T17:03:28.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a9e85db6-14b5-4c14-bb52-19ee661a56d4 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32882024-11-14T17:03:28.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a9e85db6-14b5-4c14-bb52-19ee661a56d4 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32892024-11-14T17:03:29.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c0a337e6-ac6d-4ee4-96d1-b7296f6d1033 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32902024-11-14T17:03:29.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c0a337e6-ac6d-4ee4-96d1-b7296f6d1033 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32912024-11-14T17:03:29.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c0a337e6-ac6d-4ee4-96d1-b7296f6d1033 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32922024-11-14T17:03:30.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2d639265-1b32-4ee1-bf2c-e338650cdcc3 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32932024-11-14T17:03:30.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2d639265-1b32-4ee1-bf2c-e338650cdcc3 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32942024-11-14T17:03:30.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2d639265-1b32-4ee1-bf2c-e338650cdcc3 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32952024-11-14T17:03:31.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2e6f94a5-5625-4d65-8306-89c1ef523152 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32962024-11-14T17:03:31.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2e6f94a5-5625-4d65-8306-89c1ef523152 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32972024-11-14T17:03:31.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2e6f94a5-5625-4d65-8306-89c1ef523152 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
32982024-11-14T17:03:31.597ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:48293
32992024-11-14T17:03:31.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48293 req_id = 94a22627-4366-4823-80a6-205e9642f27e roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
33002024-11-14T17:03:31.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48293 req_id = 94a22627-4366-4823-80a6-205e9642f27e resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
33012024-11-14T17:03:31.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48293 req_id = 94a22627-4366-4823-80a6-205e9642f27e response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
33022024-11-14T17:03:31.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48293 req_id = f857e054-a565-4f57-82e5-3e7738830c78 roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
33032024-11-14T17:03:31.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48293 req_id = f857e054-a565-4f57-82e5-3e7738830c78 resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
33042024-11-14T17:03:31.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48293 req_id = f857e054-a565-4f57-82e5-3e7738830c78 response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
33052024-11-14T17:03:32.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = aa77a5b8-bc9c-4ca2-8099-b28bc4679428 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33062024-11-14T17:03:32.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = aa77a5b8-bc9c-4ca2-8099-b28bc4679428 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33072024-11-14T17:03:32.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = aa77a5b8-bc9c-4ca2-8099-b28bc4679428 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33082024-11-14T17:03:33.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a9de8dc4-5ab8-48b2-a6b5-5262d315a30e roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33092024-11-14T17:03:33.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a9de8dc4-5ab8-48b2-a6b5-5262d315a30e resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33102024-11-14T17:03:33.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a9de8dc4-5ab8-48b2-a6b5-5262d315a30e response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33112024-11-14T17:03:34.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7468a085-0cad-4193-b881-21898a841c3b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33122024-11-14T17:03:34.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7468a085-0cad-4193-b881-21898a841c3b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33132024-11-14T17:03:34.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1866 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7468a085-0cad-4193-b881-21898a841c3b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33142024-11-14T17:03:35.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b4fcfd0e-78e7-420e-a137-d43f320d9e7e roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33152024-11-14T17:03:35.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b4fcfd0e-78e7-420e-a137-d43f320d9e7e resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33162024-11-14T17:03:35.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b4fcfd0e-78e7-420e-a137-d43f320d9e7e response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33172024-11-14T17:03:36.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f2382e78-0e84-4692-b6f9-e05fefd2e4a7 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33182024-11-14T17:03:36.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f2382e78-0e84-4692-b6f9-e05fefd2e4a7 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33192024-11-14T17:03:36.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f2382e78-0e84-4692-b6f9-e05fefd2e4a7 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33202024-11-14T17:03:36.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
33212024-11-14T17:03:36.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
33222024-11-14T17:03:36.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33232024-11-14T17:03:36.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33242024-11-14T17:03:36.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33252024-11-14T17:03:36.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33262024-11-14T17:03:36.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33272024-11-14T17:03:36.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33282024-11-14T17:03:36.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33292024-11-14T17:03:36.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33302024-11-14T17:03:36.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33312024-11-14T17:03:36.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33322024-11-14T17:03:36.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33332024-11-14T17:03:36.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
33342024-11-14T17:03:36.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33352024-11-14T17:03:36.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33362024-11-14T17:03:36.731ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
33372024-11-14T17:03:36.731ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.645741ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
33382024-11-14T17:03:36.737ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33392024-11-14T17:03:36.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33402024-11-14T17:03:36.739ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.760264ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33412024-11-14T17:03:37.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 68a5b2ce-4867-4e77-9841-5e680717fb2f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33422024-11-14T17:03:37.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 68a5b2ce-4867-4e77-9841-5e680717fb2f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33432024-11-14T17:03:37.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 68a5b2ce-4867-4e77-9841-5e680717fb2f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33442024-11-14T17:03:38.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f15822cc-ed50-4d5b-9de3-c1f81983bdd4 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33452024-11-14T17:03:38.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f15822cc-ed50-4d5b-9de3-c1f81983bdd4 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33462024-11-14T17:03:38.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1660 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f15822cc-ed50-4d5b-9de3-c1f81983bdd4 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33472024-11-14T17:03:39.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3928ba30-7e66-4a86-90dc-e3c68db94a10 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33482024-11-14T17:03:39.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3928ba30-7e66-4a86-90dc-e3c68db94a10 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33492024-11-14T17:03:39.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3928ba30-7e66-4a86-90dc-e3c68db94a10 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33502024-11-14T17:03:40.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c85db377-1691-4a2a-a8e6-29b5ab497cf1 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33512024-11-14T17:03:40.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c85db377-1691-4a2a-a8e6-29b5ab497cf1 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33522024-11-14T17:03:40.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c85db377-1691-4a2a-a8e6-29b5ab497cf1 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33532024-11-14T17:03:41.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be69ba1d-a995-4bed-bc82-15a3230cf91a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33542024-11-14T17:03:41.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be69ba1d-a995-4bed-bc82-15a3230cf91a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33552024-11-14T17:03:41.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be69ba1d-a995-4bed-bc82-15a3230cf91a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33562024-11-14T17:03:41.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1510 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = f6359b7a-4270-4ceb-a83b-750d414086d6 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
33572024-11-14T17:03:42.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 05b3d59f-be6a-4ee5-8e74-d3cc68db571e roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33582024-11-14T17:03:42.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 05b3d59f-be6a-4ee5-8e74-d3cc68db571e resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33592024-11-14T17:03:42.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 05b3d59f-be6a-4ee5-8e74-d3cc68db571e response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33602024-11-14T17:03:43.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e5e16bef-aedf-43a1-8031-f53f562570e8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33612024-11-14T17:03:43.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e5e16bef-aedf-43a1-8031-f53f562570e8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33622024-11-14T17:03:43.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1847 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e5e16bef-aedf-43a1-8031-f53f562570e8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33632024-11-14T17:03:44.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ab6c3fcf-45ce-4343-ab1f-877ef80ca392 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33642024-11-14T17:03:44.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ab6c3fcf-45ce-4343-ab1f-877ef80ca392 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33652024-11-14T17:03:44.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ab6c3fcf-45ce-4343-ab1f-877ef80ca392 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33662024-11-14T17:03:45.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 42877a1d-156c-4281-a91f-563b10be45e1 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33672024-11-14T17:03:45.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 42877a1d-156c-4281-a91f-563b10be45e1 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33682024-11-14T17:03:45.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 42877a1d-156c-4281-a91f-563b10be45e1 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33692024-11-14T17:03:46.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ffcc691a-5aa1-4053-ac97-64747640e4c4 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33702024-11-14T17:03:46.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ffcc691a-5aa1-4053-ac97-64747640e4c4 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33712024-11-14T17:03:46.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ffcc691a-5aa1-4053-ac97-64747640e4c4 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
33722024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
33732024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
33742024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33752024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33762024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
33772024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
33782024-11-14T17:03:46.709ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
33792024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33802024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33812024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
33822024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
33832024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33842024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33852024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
33862024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33872024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
33882024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
33892024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33902024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
33912024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33922024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
33932024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33942024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
33952024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
33962024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33972024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
33982024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33992024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34002024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34012024-11-14T17:03:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34022024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34032024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34042024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34052024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34062024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34072024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34082024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34092024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34102024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34112024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
34122024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
34132024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34142024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
34152024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
34162024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34172024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
34182024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
34192024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
34202024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
34212024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34222024-11-14T17:03:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34232024-11-14T17:03:46.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34242024-11-14T17:03:46.712ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34252024-11-14T17:03:46.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34262024-11-14T17:03:46.712ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34272024-11-14T17:03:46.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34282024-11-14T17:03:46.714ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.761037ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34292024-11-14T17:03:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34302024-11-14T17:03:46.715ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34312024-11-14T17:03:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34322024-11-14T17:03:46.716ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34332024-11-14T17:03:46.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34342024-11-14T17:03:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34352024-11-14T17:03:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34362024-11-14T17:03:46.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34372024-11-14T17:03:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34382024-11-14T17:03:46.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34392024-11-14T17:03:46.719ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2350, tv_nsec: 448691919 } })
34402024-11-14T17:03:46.719ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
34412024-11-14T17:03:46.719ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34422024-11-14T17:03:46.720ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2350, tv_nsec: 450481640 } })
34432024-11-14T17:03:46.721ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
34442024-11-14T17:03:46.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34452024-11-14T17:03:46.721ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34462024-11-14T17:03:46.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34472024-11-14T17:03:46.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34482024-11-14T17:03:46.722ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34492024-11-14T17:03:46.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34502024-11-14T17:03:46.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.003286ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
34512024-11-14T17:03:46.725ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 16.521423ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34522024-11-14T17:03:46.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34532024-11-14T17:03:46.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34542024-11-14T17:03:46.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34552024-11-14T17:03:46.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34562024-11-14T17:03:46.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34572024-11-14T17:03:46.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34582024-11-14T17:03:46.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34592024-11-14T17:03:46.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34602024-11-14T17:03:46.729ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34612024-11-14T17:03:46.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34622024-11-14T17:03:46.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34632024-11-14T17:03:46.731ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34642024-11-14T17:03:46.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
34652024-11-14T17:03:46.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34662024-11-14T17:03:46.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34672024-11-14T17:03:46.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34682024-11-14T17:03:46.735ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34692024-11-14T17:03:46.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34702024-11-14T17:03:46.746ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
34712024-11-14T17:03:46.746ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.77476ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
34722024-11-14T17:03:46.752ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34732024-11-14T17:03:46.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34742024-11-14T17:03:46.767ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34752024-11-14T17:03:46.767ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34762024-11-14T17:03:46.767ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34772024-11-14T17:03:46.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34782024-11-14T17:03:46.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34792024-11-14T17:03:46.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34802024-11-14T17:03:46.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34812024-11-14T17:03:46.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34822024-11-14T17:03:46.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34832024-11-14T17:03:46.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34842024-11-14T17:03:46.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34852024-11-14T17:03:46.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34862024-11-14T17:03:46.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34872024-11-14T17:03:46.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
34882024-11-14T17:03:46.775ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34892024-11-14T17:03:46.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34902024-11-14T17:03:46.776ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34912024-11-14T17:03:46.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34922024-11-14T17:03:46.778ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
34932024-11-14T17:03:46.778ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.748011ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
34942024-11-14T17:03:46.781ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 71.954213ms iteration = 20 status = 0
34952024-11-14T17:03:46.781ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2350, tv_nsec: 510772240 } })
34962024-11-14T17:03:46.781ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
34972024-11-14T17:03:46.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.166506ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
34982024-11-14T17:03:46.785ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34992024-11-14T17:03:46.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35002024-11-14T17:03:46.806ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
35012024-11-14T17:03:46.806ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35022024-11-14T17:03:46.806ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de8d5602-ca96-4bf5-ae6e-d3f58e7d2bfd", "content-length": "26", "date": "Thu, 14 Nov 2024 17:03:46 GMT"} })
35032024-11-14T17:03:46.806ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35042024-11-14T17:03:46.808ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35052024-11-14T17:03:46.814ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35062024-11-14T17:03:46.814ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35072024-11-14T17:03:46.814ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35082024-11-14T17:03:46.814ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
35092024-11-14T17:03:46.814ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35102024-11-14T17:03:46.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35112024-11-14T17:03:46.814ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53107d44-0e2a-4fdf-95bf-0f22a711d80f", "content-length": "26", "date": "Thu, 14 Nov 2024 17:03:46 GMT"} })
35122024-11-14T17:03:46.814ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35132024-11-14T17:03:46.815ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.369718ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
35142024-11-14T17:03:46.816ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 106.979944ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35152024-11-14T17:03:46.816ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35162024-11-14T17:03:46.822ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35172024-11-14T17:03:46.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35182024-11-14T17:03:46.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 115.535017ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
35192024-11-14T17:03:46.833ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35202024-11-14T17:03:46.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35212024-11-14T17:03:46.858ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35222024-11-14T17:03:46.858ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35232024-11-14T17:03:46.858ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 149.070483ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35242024-11-14T17:03:46.877ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.727554ms iteration = 23 status = {"physical_disks_added":0}
35252024-11-14T17:03:46.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35262024-11-14T17:03:46.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35272024-11-14T17:03:46.888ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
35282024-11-14T17:03:46.888ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35292024-11-14T17:03:46.888ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1178de68-d44e-48d2-9dbd-6ae641c6fbe1", "content-length": "26", "date": "Thu, 14 Nov 2024 17:03:46 GMT"} })
35302024-11-14T17:03:46.888ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35312024-11-14T17:03:46.891ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
35322024-11-14T17:03:47.005ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35332024-11-14T17:03:47.006ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff6470d8-7564-45db-8e89-a82a25cd2934", "content-length": "1", "date": "Thu, 14 Nov 2024 17:03:46 GMT"} })
35342024-11-14T17:03:47.007ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35352024-11-14T17:03:47.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35362024-11-14T17:03:47.024ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 315.261013ms iteration = 20 status = {}
35372024-11-14T17:03:47.029ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35382024-11-14T17:03:47.029ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35392024-11-14T17:03:47.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35402024-11-14T17:03:47.031ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 322.536888ms iteration = 20 status = null
35412024-11-14T17:03:47.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35422024-11-14T17:03:47.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35432024-11-14T17:03:47.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35442024-11-14T17:03:47.034ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35452024-11-14T17:03:47.036ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35462024-11-14T17:03:47.036ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35472024-11-14T17:03:47.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35482024-11-14T17:03:47.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = bb693152-0bc3-403a-aac6-9174d1636ddd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
35492024-11-14T17:03:47.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = bb693152-0bc3-403a-aac6-9174d1636ddd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
35502024-11-14T17:03:47.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = bb693152-0bc3-403a-aac6-9174d1636ddd response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
35512024-11-14T17:03:47.154ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d505633-bd70-4dfe-8816-a6d00b84bc5f", "content-length": "372", "date": "Thu, 14 Nov 2024 17:03:47 GMT"} })
35522024-11-14T17:03:47.154ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35532024-11-14T17:03:47.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35542024-11-14T17:03:47.165ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35552024-11-14T17:03:47.165ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a59eef9-df4f-43b9-9875-069fcb416c54", "content-length": "691", "date": "Thu, 14 Nov 2024 17:03:47 GMT"} })
35562024-11-14T17:03:47.165ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
35572024-11-14T17:03:47.165ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
35582024-11-14T17:03:47.165ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
35592024-11-14T17:03:47.168ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 459.435236ms iteration = 20 status = {}
35602024-11-14T17:03:47.175ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
35612024-11-14T17:03:47.175ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
35622024-11-14T17:03:47.175ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "77ee93b3-d83c-4b32-bfb6-c8acfa2c0d19", "date": "Thu, 14 Nov 2024 17:03:47 GMT"} })
35632024-11-14T17:03:47.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35642024-11-14T17:03:47.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35652024-11-14T17:03:47.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35662024-11-14T17:03:47.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35672024-11-14T17:03:47.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35682024-11-14T17:03:47.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35692024-11-14T17:03:47.187ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
35702024-11-14T17:03:47.187ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35712024-11-14T17:03:47.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35722024-11-14T17:03:47.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35732024-11-14T17:03:47.204ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
35742024-11-14T17:03:47.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35752024-11-14T17:03:47.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35762024-11-14T17:03:47.218ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35772024-11-14T17:03:47.219ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c5463dd-45bc-4eb9-b676-4559acf42d3b", "content-length": "134", "date": "Thu, 14 Nov 2024 17:03:47 GMT"} })
35782024-11-14T17:03:47.219ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
35792024-11-14T17:03:47.219ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
35802024-11-14T17:03:47.219ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
35812024-11-14T17:03:47.219ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35822024-11-14T17:03:47.219ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35832024-11-14T17:03:47.219ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35842024-11-14T17:03:47.219ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35852024-11-14T17:03:47.219ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35862024-11-14T17:03:47.219ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35872024-11-14T17:03:47.219ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35882024-11-14T17:03:47.219ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
35892024-11-14T17:03:47.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35902024-11-14T17:03:47.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35912024-11-14T17:03:47.223ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35922024-11-14T17:03:47.223ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba0836d9-f45e-4973-88c2-29654f0c2bc4", "content-length": "2", "date": "Thu, 14 Nov 2024 17:03:47 GMT"} })
35932024-11-14T17:03:47.223ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35942024-11-14T17:03:47.223ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d9c9c4b-b248-4e73-ba93-60b6ef94c6dd", "content-length": "52", "date": "Thu, 14 Nov 2024 17:03:47 GMT"} })
35952024-11-14T17:03:47.223ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
35962024-11-14T17:03:47.223ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35972024-11-14T17:03:47.332ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1b2ae188-da91-4ff4-8786-45487766a7c7", "date": "Thu, 14 Nov 2024 17:03:47 GMT"} })
35982024-11-14T17:03:47.334ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 625.231526ms iteration = 21 status = {}
35992024-11-14T17:03:47.447ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "76a8074e-a243-4a33-830e-91eb8c17e530", "date": "Thu, 14 Nov 2024 17:03:46 GMT"} })
36002024-11-14T17:03:47.447ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
36012024-11-14T17:03:47.447ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36022024-11-14T17:03:47.448ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa560b4e-4d62-446c-890a-3f1e51f77f10", "content-length": "682", "date": "Thu, 14 Nov 2024 17:03:47 GMT"} })
36032024-11-14T17:03:47.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36042024-11-14T17:03:47.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36052024-11-14T17:03:47.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36062024-11-14T17:03:47.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36072024-11-14T17:03:47.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36082024-11-14T17:03:47.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36092024-11-14T17:03:47.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36102024-11-14T17:03:47.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36112024-11-14T17:03:47.467ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 757.768707ms iteration = 20 status = {}
36122024-11-14T17:03:47.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d42c38a8-77d0-4277-a68f-69b4ff9a3bce roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36132024-11-14T17:03:47.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d42c38a8-77d0-4277-a68f-69b4ff9a3bce resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36142024-11-14T17:03:47.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d42c38a8-77d0-4277-a68f-69b4ff9a3bce response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36152024-11-14T17:03:48.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f63944fc-74b5-41f3-a5d7-ad3463a3d600 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36162024-11-14T17:03:48.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f63944fc-74b5-41f3-a5d7-ad3463a3d600 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36172024-11-14T17:03:48.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f63944fc-74b5-41f3-a5d7-ad3463a3d600 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36182024-11-14T17:03:49.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cf397470-d521-4e7b-b2d1-d871b2f5738e roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36192024-11-14T17:03:49.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cf397470-d521-4e7b-b2d1-d871b2f5738e resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36202024-11-14T17:03:49.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cf397470-d521-4e7b-b2d1-d871b2f5738e response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36212024-11-14T17:03:50.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 78930515-c33d-48ff-afb7-d859e05b7cba roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36222024-11-14T17:03:50.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 78930515-c33d-48ff-afb7-d859e05b7cba resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36232024-11-14T17:03:50.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 78930515-c33d-48ff-afb7-d859e05b7cba response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36242024-11-14T17:03:51.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2c85f59c-c0ec-4b24-b992-1f22e0747afc roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36252024-11-14T17:03:51.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2c85f59c-c0ec-4b24-b992-1f22e0747afc resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36262024-11-14T17:03:51.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2c85f59c-c0ec-4b24-b992-1f22e0747afc response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36272024-11-14T17:03:52.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4dde2df8-2d20-4eb9-9d16-ebf168f072c3 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36282024-11-14T17:03:52.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4dde2df8-2d20-4eb9-9d16-ebf168f072c3 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36292024-11-14T17:03:52.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4dde2df8-2d20-4eb9-9d16-ebf168f072c3 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36302024-11-14T17:03:53.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b85d4bce-dcb4-4a86-bf8e-a4c31894ce04 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36312024-11-14T17:03:53.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b85d4bce-dcb4-4a86-bf8e-a4c31894ce04 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36322024-11-14T17:03:53.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b85d4bce-dcb4-4a86-bf8e-a4c31894ce04 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36332024-11-14T17:03:54.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3ff6fdc9-2d8d-4d59-8019-5de24d41e6b0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36342024-11-14T17:03:54.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3ff6fdc9-2d8d-4d59-8019-5de24d41e6b0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36352024-11-14T17:03:54.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3ff6fdc9-2d8d-4d59-8019-5de24d41e6b0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36362024-11-14T17:03:55.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 76e844fa-4e7d-4528-8bb5-300316002779 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36372024-11-14T17:03:55.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 76e844fa-4e7d-4528-8bb5-300316002779 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36382024-11-14T17:03:55.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 76e844fa-4e7d-4528-8bb5-300316002779 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36392024-11-14T17:03:56.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = f6ded4f2-f51a-4927-895f-e2bcf8765e47 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
36402024-11-14T17:03:56.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
36412024-11-14T17:03:56.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36422024-11-14T17:03:56.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
36432024-11-14T17:03:56.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36442024-11-14T17:03:56.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36452024-11-14T17:03:56.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36462024-11-14T17:03:56.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36472024-11-14T17:03:56.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36482024-11-14T17:03:56.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36492024-11-14T17:03:56.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36502024-11-14T17:03:56.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36512024-11-14T17:03:56.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36522024-11-14T17:03:56.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36532024-11-14T17:03:56.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
36542024-11-14T17:03:56.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36552024-11-14T17:03:56.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36562024-11-14T17:03:56.728ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
36572024-11-14T17:03:56.728ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.285146ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
36582024-11-14T17:03:56.737ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36592024-11-14T17:03:56.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36602024-11-14T17:03:56.738ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.986507ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36612024-11-14T17:03:56.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 84bb949d-5955-4fb6-a0be-ed86f9baf6aa roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36622024-11-14T17:03:56.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 84bb949d-5955-4fb6-a0be-ed86f9baf6aa resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36632024-11-14T17:03:56.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1748 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 84bb949d-5955-4fb6-a0be-ed86f9baf6aa response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36642024-11-14T17:03:57.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 42781b75-b790-4c5e-a494-3e5401b5dfb0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36652024-11-14T17:03:57.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 42781b75-b790-4c5e-a494-3e5401b5dfb0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36662024-11-14T17:03:57.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1721 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 42781b75-b790-4c5e-a494-3e5401b5dfb0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36672024-11-14T17:03:58.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 75632b99-302d-4a07-8781-66f3dfb7c29d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36682024-11-14T17:03:58.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 75632b99-302d-4a07-8781-66f3dfb7c29d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36692024-11-14T17:03:58.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 75632b99-302d-4a07-8781-66f3dfb7c29d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36702024-11-14T17:03:59.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0e0567c2-6083-49f0-ba46-c24417353476 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36712024-11-14T17:03:59.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0e0567c2-6083-49f0-ba46-c24417353476 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36722024-11-14T17:03:59.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2765 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0e0567c2-6083-49f0-ba46-c24417353476 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36732024-11-14T17:04:00.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9d61fe66-68d2-46ed-9fea-5bd4674844e8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36742024-11-14T17:04:00.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9d61fe66-68d2-46ed-9fea-5bd4674844e8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36752024-11-14T17:04:00.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9d61fe66-68d2-46ed-9fea-5bd4674844e8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36762024-11-14T17:04:01.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48293 req_id = e044aa48-7d44-4a4a-8775-c2e8b4eb0d01 roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
36772024-11-14T17:04:01.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48293 req_id = e044aa48-7d44-4a4a-8775-c2e8b4eb0d01 resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
36782024-11-14T17:04:01.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48293 req_id = e044aa48-7d44-4a4a-8775-c2e8b4eb0d01 response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
36792024-11-14T17:04:01.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48293 req_id = 6cfe9ab0-41df-4aeb-95e9-91a99f62f0fc roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
36802024-11-14T17:04:01.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48293 req_id = 6cfe9ab0-41df-4aeb-95e9-91a99f62f0fc resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
36812024-11-14T17:04:01.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48293 req_id = 6cfe9ab0-41df-4aeb-95e9-91a99f62f0fc response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
36822024-11-14T17:04:01.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3657f802-2364-43be-8fcf-3294bb8ed51d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36832024-11-14T17:04:01.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3657f802-2364-43be-8fcf-3294bb8ed51d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36842024-11-14T17:04:01.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3657f802-2364-43be-8fcf-3294bb8ed51d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36852024-11-14T17:04:03.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7b5a2801-755f-49df-b02b-bea5dfba709c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36862024-11-14T17:04:03.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7b5a2801-755f-49df-b02b-bea5dfba709c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36872024-11-14T17:04:03.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7b5a2801-755f-49df-b02b-bea5dfba709c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36882024-11-14T17:04:04.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1ec3af9f-d1be-4f3b-b18f-3ba7d7a279a0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36892024-11-14T17:04:04.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1ec3af9f-d1be-4f3b-b18f-3ba7d7a279a0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36902024-11-14T17:04:04.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1ec3af9f-d1be-4f3b-b18f-3ba7d7a279a0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36912024-11-14T17:04:05.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7d1e9ca9-ba26-40a1-b308-e8ea9b2a4a6b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36922024-11-14T17:04:05.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7d1e9ca9-ba26-40a1-b308-e8ea9b2a4a6b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36932024-11-14T17:04:05.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7d1e9ca9-ba26-40a1-b308-e8ea9b2a4a6b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36942024-11-14T17:04:06.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 91ddf2c1-2c69-49e0-8fdc-5129a3e0c580 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36952024-11-14T17:04:06.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 91ddf2c1-2c69-49e0-8fdc-5129a3e0c580 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36962024-11-14T17:04:06.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 91ddf2c1-2c69-49e0-8fdc-5129a3e0c580 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
36972024-11-14T17:04:06.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
36982024-11-14T17:04:06.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36992024-11-14T17:04:06.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
37002024-11-14T17:04:06.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37012024-11-14T17:04:06.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37022024-11-14T17:04:06.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37032024-11-14T17:04:06.711ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37042024-11-14T17:04:06.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37052024-11-14T17:04:06.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37062024-11-14T17:04:06.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.145874ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37072024-11-14T17:04:06.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37082024-11-14T17:04:06.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37092024-11-14T17:04:06.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37102024-11-14T17:04:06.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37112024-11-14T17:04:06.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37122024-11-14T17:04:06.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37132024-11-14T17:04:06.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
37142024-11-14T17:04:06.720ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37152024-11-14T17:04:06.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37162024-11-14T17:04:06.731ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
37172024-11-14T17:04:06.731ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.972188ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
37182024-11-14T17:04:07.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 32b96f57-c62c-4d0e-ac03-786931ecd65c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37192024-11-14T17:04:07.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 32b96f57-c62c-4d0e-ac03-786931ecd65c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37202024-11-14T17:04:07.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 32b96f57-c62c-4d0e-ac03-786931ecd65c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37212024-11-14T17:04:08.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 793c2473-ab4e-43e4-b509-faf11baed776 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37222024-11-14T17:04:08.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 793c2473-ab4e-43e4-b509-faf11baed776 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37232024-11-14T17:04:08.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 793c2473-ab4e-43e4-b509-faf11baed776 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37242024-11-14T17:04:09.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f97b1d13-b481-4fba-8ec3-08f846fa69c8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37252024-11-14T17:04:09.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f97b1d13-b481-4fba-8ec3-08f846fa69c8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37262024-11-14T17:04:09.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1643 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f97b1d13-b481-4fba-8ec3-08f846fa69c8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37272024-11-14T17:04:10.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0f8f4bed-bd70-4837-b2e4-b0ca40654cef roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37282024-11-14T17:04:10.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0f8f4bed-bd70-4837-b2e4-b0ca40654cef resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37292024-11-14T17:04:10.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0f8f4bed-bd70-4837-b2e4-b0ca40654cef response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37302024-11-14T17:04:11.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 59a439b5-ba3d-49cf-a7dd-4e21118d4b7f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37312024-11-14T17:04:11.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 59a439b5-ba3d-49cf-a7dd-4e21118d4b7f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37322024-11-14T17:04:11.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 59a439b5-ba3d-49cf-a7dd-4e21118d4b7f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37332024-11-14T17:04:11.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1659 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = cf0b9004-82ff-4334-b114-1b3cfb7d0493 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
37342024-11-14T17:04:12.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9eafbc3c-e057-4f61-a5a0-69c6d5eef242 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37352024-11-14T17:04:12.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9eafbc3c-e057-4f61-a5a0-69c6d5eef242 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37362024-11-14T17:04:12.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9eafbc3c-e057-4f61-a5a0-69c6d5eef242 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37372024-11-14T17:04:13.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 20ab1ca5-bee8-4bc3-bb1a-0097626faeb2 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37382024-11-14T17:04:13.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 20ab1ca5-bee8-4bc3-bb1a-0097626faeb2 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37392024-11-14T17:04:13.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 20ab1ca5-bee8-4bc3-bb1a-0097626faeb2 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37402024-11-14T17:04:14.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 93408ba5-6d64-422a-990c-690f7f7ab0ae roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37412024-11-14T17:04:14.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 93408ba5-6d64-422a-990c-690f7f7ab0ae resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37422024-11-14T17:04:14.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 93408ba5-6d64-422a-990c-690f7f7ab0ae response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37432024-11-14T17:04:15.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9ccd45d2-6642-4b13-90d8-8de469348062 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37442024-11-14T17:04:15.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9ccd45d2-6642-4b13-90d8-8de469348062 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37452024-11-14T17:04:15.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9ccd45d2-6642-4b13-90d8-8de469348062 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37462024-11-14T17:04:16.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = edd7d58f-02d4-40c4-9648-512104e50315 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37472024-11-14T17:04:16.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = edd7d58f-02d4-40c4-9648-512104e50315 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37482024-11-14T17:04:16.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = edd7d58f-02d4-40c4-9648-512104e50315 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
37492024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
37502024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
37512024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37522024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
37532024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
37542024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
37552024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37562024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37572024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
37582024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37592024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
37602024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
37612024-11-14T17:04:16.709ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
37622024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37632024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
37642024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37652024-11-14T17:04:16.709ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5
37662024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
37672024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.02\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5"}
37682024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
37692024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
37702024-11-14T17:04:16.709ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
37712024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
37722024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37732024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
37742024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
37752024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37762024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37772024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
37782024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
37792024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37802024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
37812024-11-14T17:04:16.709ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
37822024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
37832024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
37842024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37852024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
37862024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
37872024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
37882024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37892024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
37902024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37912024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
37922024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37932024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
37942024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
37952024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37962024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
37972024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
37982024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
37992024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
38002024-11-14T17:04:16.709ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 16:54:16.709372337 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
38012024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
38022024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
38032024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38042024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38052024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38062024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38072024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38082024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38092024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38102024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38112024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38122024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
38132024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38142024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38152024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38162024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38172024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38182024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
38192024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
38202024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
38212024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38222024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38232024-11-14T17:04:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38242024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
38252024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
38262024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
38272024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38282024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
38292024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
38302024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
38312024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38322024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38332024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
38342024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
38352024-11-14T17:04:16.710ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
38362024-11-14T17:04:16.710ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
38372024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38382024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38392024-11-14T17:04:16.710ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94482e71-9503-4d09-b73f-615fbf343a2e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2380, tv_nsec: 439373724 } })
38402024-11-14T17:04:16.710ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89b01be2-c37f-445d-addd-6b4be9cd73c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc5fdca1-6d92-4ff4-b5ae-2f44553a2186.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2380, tv_nsec: 439398145 } })
38412024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
38422024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38432024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38442024-11-14T17:04:16.710ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
38452024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38462024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
38472024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38482024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
38492024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.229538ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
38502024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
38512024-11-14T17:04:16.710ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.429102ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
38522024-11-14T17:04:16.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38532024-11-14T17:04:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38542024-11-14T17:04:16.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38552024-11-14T17:04:16.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38562024-11-14T17:04:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38572024-11-14T17:04:16.713ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38582024-11-14T17:04:16.713ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.364599ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
38592024-11-14T17:04:16.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38602024-11-14T17:04:16.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38612024-11-14T17:04:16.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38622024-11-14T17:04:16.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
38632024-11-14T17:04:16.715ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38642024-11-14T17:04:16.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38652024-11-14T17:04:16.717ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38662024-11-14T17:04:16.717ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38672024-11-14T17:04:16.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38682024-11-14T17:04:16.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38692024-11-14T17:04:16.718ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38702024-11-14T17:04:16.718ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
38712024-11-14T17:04:16.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
38722024-11-14T17:04:16.719ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38732024-11-14T17:04:16.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38742024-11-14T17:04:16.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
38752024-11-14T17:04:16.720ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38762024-11-14T17:04:16.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38772024-11-14T17:04:16.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
38782024-11-14T17:04:16.721ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38792024-11-14T17:04:16.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38802024-11-14T17:04:16.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
38812024-11-14T17:04:16.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38822024-11-14T17:04:16.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38832024-11-14T17:04:16.721ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38842024-11-14T17:04:16.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38852024-11-14T17:04:16.722ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38862024-11-14T17:04:16.722ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38872024-11-14T17:04:16.723ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38882024-11-14T17:04:16.725ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
38892024-11-14T17:04:16.725ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38902024-11-14T17:04:16.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38912024-11-14T17:04:16.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38922024-11-14T17:04:16.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38932024-11-14T17:04:16.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38942024-11-14T17:04:16.726ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
38952024-11-14T17:04:16.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
38962024-11-14T17:04:16.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
38972024-11-14T17:04:16.728ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 16:54:16.709372337 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
38982024-11-14T17:04:16.728ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.170082ms iteration = 11 status = {"expiration":"2024-11-14T16:54:16.709372337Z","pruned":[]}
38992024-11-14T17:04:16.728ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2380, tv_nsec: 458299381 } })
39002024-11-14T17:04:16.729ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2380, tv_nsec: 458380193 } })
39012024-11-14T17:04:16.729ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
39022024-11-14T17:04:16.729ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
39032024-11-14T17:04:16.729ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.885399ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
39042024-11-14T17:04:16.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 20.328398ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
39052024-11-14T17:04:16.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39062024-11-14T17:04:16.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39072024-11-14T17:04:16.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39082024-11-14T17:04:16.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39092024-11-14T17:04:16.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39102024-11-14T17:04:16.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39112024-11-14T17:04:16.744ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39122024-11-14T17:04:16.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39132024-11-14T17:04:16.746ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
39142024-11-14T17:04:16.746ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
39152024-11-14T17:04:16.746ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 36.75565ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
39162024-11-14T17:04:16.747ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39172024-11-14T17:04:16.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39182024-11-14T17:04:16.754ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
39192024-11-14T17:04:16.754ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
39202024-11-14T17:04:16.754ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
39212024-11-14T17:04:16.754ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2380, tv_nsec: 483520130 } })
39222024-11-14T17:04:16.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39232024-11-14T17:04:16.754ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
39242024-11-14T17:04:16.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39252024-11-14T17:04:16.755ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39262024-11-14T17:04:16.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39272024-11-14T17:04:16.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39282024-11-14T17:04:16.756ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39292024-11-14T17:04:16.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39302024-11-14T17:04:16.757ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39312024-11-14T17:04:16.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39322024-11-14T17:04:16.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
39332024-11-14T17:04:16.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39342024-11-14T17:04:16.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39352024-11-14T17:04:16.760ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(8d55bbf2-7c21-4b79-a6b9-52d2672d5792, 0), (190d5d63-8367-4788-8b02-47536818d8a2, 0), (c7753c18-6389-4517-902b-dd6f70dee03b, 0), (fabbe090-cfc9-4a23-83bc-05d531a7620c, 0)] collection_id = 8d55bbf2-7c21-4b79-a6b9-52d2672d5792
39362024-11-14T17:04:16.760ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
39372024-11-14T17:04:16.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
39382024-11-14T17:04:16.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39392024-11-14T17:04:16.763ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39402024-11-14T17:04:16.763ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39412024-11-14T17:04:16.765ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39422024-11-14T17:04:16.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39432024-11-14T17:04:16.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39442024-11-14T17:04:16.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39452024-11-14T17:04:16.767ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39462024-11-14T17:04:16.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39472024-11-14T17:04:16.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39482024-11-14T17:04:16.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39492024-11-14T17:04:16.768ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39502024-11-14T17:04:16.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
39512024-11-14T17:04:16.768ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39522024-11-14T17:04:16.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39532024-11-14T17:04:16.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39542024-11-14T17:04:16.777ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39552024-11-14T17:04:16.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39562024-11-14T17:04:16.781ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.590638ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39572024-11-14T17:04:16.783ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
39582024-11-14T17:04:16.783ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 0 version = 2
39592024-11-14T17:04:16.783ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39602024-11-14T17:04:16.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39612024-11-14T17:04:16.790ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39622024-11-14T17:04:16.792ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39632024-11-14T17:04:16.792ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39642024-11-14T17:04:16.792ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39652024-11-14T17:04:16.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39662024-11-14T17:04:16.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
39672024-11-14T17:04:16.796ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39682024-11-14T17:04:16.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39692024-11-14T17:04:16.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39702024-11-14T17:04:16.801ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39712024-11-14T17:04:16.801ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39722024-11-14T17:04:16.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39732024-11-14T17:04:16.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 92.353654ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39742024-11-14T17:04:16.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39752024-11-14T17:04:16.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 92.542858ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
39762024-11-14T17:04:16.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39772024-11-14T17:04:16.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39782024-11-14T17:04:16.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39792024-11-14T17:04:16.807ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39802024-11-14T17:04:16.807ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
39812024-11-14T17:04:16.807ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
39822024-11-14T17:04:16.807ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
39832024-11-14T17:04:16.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39842024-11-14T17:04:16.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39852024-11-14T17:04:16.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39862024-11-14T17:04:16.808ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 1 version = 2
39872024-11-14T17:04:16.808ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
39882024-11-14T17:04:16.809ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 16:54:47.468912 UTC dns_group = external generation = 2
39892024-11-14T17:04:16.809ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 99.935175ms iteration = 12 status = {"generation":2}
39902024-11-14T17:04:16.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39912024-11-14T17:04:16.810ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
39922024-11-14T17:04:16.810ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = e8e149d6-38ee-41a8-aebe-e8935b138a0d
39932024-11-14T17:04:16.810ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 3205269a-e919-4f3a-a65f-c47eeb9f7f42
39942024-11-14T17:04:16.810ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39952024-11-14T17:04:16.810ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39962024-11-14T17:04:16.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39972024-11-14T17:04:16.813ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39982024-11-14T17:04:16.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39992024-11-14T17:04:16.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40002024-11-14T17:04:16.814ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 351901f6-63c1-4e7b-a304-7876fce2fe88
40012024-11-14T17:04:16.814ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 3205269a-e919-4f3a-a65f-c47eeb9f7f42
40022024-11-14T17:04:16.814ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 351901f6-63c1-4e7b-a304-7876fce2fe88
40032024-11-14T17:04:16.814ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = e8e149d6-38ee-41a8-aebe-e8935b138a0d
40042024-11-14T17:04:16.814ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
40052024-11-14T17:04:16.814ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
40062024-11-14T17:04:16.814ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 105.433689ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
40072024-11-14T17:04:16.814ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 104.743733ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
40082024-11-14T17:04:16.815ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
40092024-11-14T17:04:16.815ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 106.36951ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
40102024-11-14T17:04:16.815ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40112024-11-14T17:04:16.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40122024-11-14T17:04:16.815ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40132024-11-14T17:04:16.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40142024-11-14T17:04:16.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40152024-11-14T17:04:16.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40162024-11-14T17:04:16.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40172024-11-14T17:04:16.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40182024-11-14T17:04:16.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40192024-11-14T17:04:16.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40202024-11-14T17:04:16.821ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40212024-11-14T17:04:16.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40222024-11-14T17:04:16.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40232024-11-14T17:04:16.822ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40242024-11-14T17:04:16.822ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 113.073841ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40252024-11-14T17:04:16.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40262024-11-14T17:04:16.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
40272024-11-14T17:04:16.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40282024-11-14T17:04:16.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40292024-11-14T17:04:16.828ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 118.874072ms iteration = 21 status = 0
40302024-11-14T17:04:16.855ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 8d55bbf2-7c21-4b79-a6b9-52d2672d5792 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
40312024-11-14T17:04:16.855ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
40322024-11-14T17:04:16.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
40332024-11-14T17:04:16.856ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
40342024-11-14T17:04:16.865ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40352024-11-14T17:04:16.865ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40362024-11-14T17:04:16.865ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 156.216414ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40372024-11-14T17:04:16.865ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40382024-11-14T17:04:16.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40392024-11-14T17:04:16.866ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
40402024-11-14T17:04:16.866ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
40412024-11-14T17:04:16.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40422024-11-14T17:04:16.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40432024-11-14T17:04:16.867ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40442024-11-14T17:04:16.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40452024-11-14T17:04:16.868ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(190d5d63-8367-4788-8b02-47536818d8a2, 0), (c7753c18-6389-4517-902b-dd6f70dee03b, 0), (fabbe090-cfc9-4a23-83bc-05d531a7620c, 0)]
40462024-11-14T17:04:16.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40472024-11-14T17:04:16.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40482024-11-14T17:04:16.869ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2380, tv_nsec: 598484604 } })
40492024-11-14T17:04:16.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 160.691056ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40502024-11-14T17:04:16.870ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40512024-11-14T17:04:16.872ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
40522024-11-14T17:04:16.873ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40532024-11-14T17:04:16.873ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40542024-11-14T17:04:16.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40552024-11-14T17:04:16.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40562024-11-14T17:04:16.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40572024-11-14T17:04:16.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40582024-11-14T17:04:16.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
40592024-11-14T17:04:16.877ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40602024-11-14T17:04:16.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40612024-11-14T17:04:16.879ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40622024-11-14T17:04:16.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40632024-11-14T17:04:16.881ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40642024-11-14T17:04:16.881ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
40652024-11-14T17:04:16.881ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 172.698516ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
40662024-11-14T17:04:16.882ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
40672024-11-14T17:04:16.882ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
40682024-11-14T17:04:16.882ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 16:54:46.198050 UTC dns_group = internal generation = 1
40692024-11-14T17:04:16.882ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 173.086425ms iteration = 12 status = {"generation":1}
40702024-11-14T17:04:16.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40712024-11-14T17:04:16.885ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40722024-11-14T17:04:16.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40732024-11-14T17:04:16.888ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40742024-11-14T17:04:16.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40752024-11-14T17:04:16.892ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40762024-11-14T17:04:16.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40772024-11-14T17:04:16.893ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T16:54:14.392760Z, time_modified: 2024-11-14T16:54:14.392760Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }) }
40782024-11-14T17:04:16.893ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 184.595645ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]}},"default_endpoint":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
40792024-11-14T17:04:16.894ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40802024-11-14T17:04:16.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40812024-11-14T17:04:16.896ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40822024-11-14T17:04:16.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40832024-11-14T17:04:16.906ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40842024-11-14T17:04:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
40852024-11-14T17:04:16.914ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40862024-11-14T17:04:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40872024-11-14T17:04:16.919ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
40882024-11-14T17:04:16.919ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40892024-11-14T17:04:16.920ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40902024-11-14T17:04:16.921ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b070f3df-9e33-4b94-8615-56828a5281cd", "content-length": "26", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
40912024-11-14T17:04:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40922024-11-14T17:04:16.921ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40932024-11-14T17:04:16.924ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40942024-11-14T17:04:16.935ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40952024-11-14T17:04:16.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40962024-11-14T17:04:16.942ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40972024-11-14T17:04:16.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40982024-11-14T17:04:16.946ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40992024-11-14T17:04:16.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41002024-11-14T17:04:16.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 237.036328ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
41012024-11-14T17:04:16.948ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41022024-11-14T17:04:16.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41032024-11-14T17:04:16.950ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41042024-11-14T17:04:16.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41052024-11-14T17:04:16.952ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41062024-11-14T17:04:16.958ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
41072024-11-14T17:04:16.958ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41082024-11-14T17:04:16.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41092024-11-14T17:04:16.959ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41102024-11-14T17:04:16.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41112024-11-14T17:04:17.009ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 299.732792ms iteration = 24 status = {"physical_disks_added":0}
41122024-11-14T17:04:17.035ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
41132024-11-14T17:04:17.035ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41142024-11-14T17:04:17.035ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d3c7028-e8d4-41ef-b47f-5a143e98751b", "content-length": "26", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41152024-11-14T17:04:17.035ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41162024-11-14T17:04:17.038ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
41172024-11-14T17:04:17.056ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
41182024-11-14T17:04:17.056ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
41192024-11-14T17:04:17.056ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
41202024-11-14T17:04:17.056ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "6306645d-801d-4310-91ac-dd815b373b09", "content-length": "476", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41212024-11-14T17:04:17.056ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
41222024-11-14T17:04:17.057ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d144ff0-5dd1-4e70-8b1b-abad44beb8c7", "content-length": "734", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41232024-11-14T17:04:17.057ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
41242024-11-14T17:04:17.057ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "73addff5-6753-4f5b-9050-34c379b16958", "content-length": "111", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41252024-11-14T17:04:17.057ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
41262024-11-14T17:04:17.057ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "47343932-eca8-438b-9b6d-a45b79c2e53f", "content-length": "111", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41272024-11-14T17:04:17.057ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
41282024-11-14T17:04:17.058ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e046d12b-ebc9-4f46-891a-e562c1febd64", "content-length": "167", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41292024-11-14T17:04:17.058ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
41302024-11-14T17:04:17.058ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "09e25b04-8906-4e37-820a-b54141d5626f", "content-length": "167", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41312024-11-14T17:04:17.058ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
41322024-11-14T17:04:17.058ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "796d4052-9596-4864-8f99-a297409f6c6b", "content-length": "175", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41332024-11-14T17:04:17.058ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
41342024-11-14T17:04:17.058ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "282f8460-deb0-41c9-9cb0-98dff98972af", "content-length": "175", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41352024-11-14T17:04:17.058ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
41362024-11-14T17:04:17.059ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "877bd856-719c-42c7-8cde-f310d520a1a5", "content-length": "702", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41372024-11-14T17:04:17.059ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
41382024-11-14T17:04:17.059ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "833b17ca-5c55-4f64-851b-bb3cd7cd9d5e", "content-length": "727", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41392024-11-14T17:04:17.059ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
41402024-11-14T17:04:17.059ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a7d4c33-98d9-4f9d-9151-8b640a12b3ad", "content-length": "729", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41412024-11-14T17:04:17.059ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
41422024-11-14T17:04:17.059ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b965e81c-bafd-46e3-bba7-b1a434abd425", "content-length": "728", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41432024-11-14T17:04:17.059ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
41442024-11-14T17:04:17.059ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "df914e71-5d9b-4db5-b1d4-87aecb12a094", "content-length": "722", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41452024-11-14T17:04:17.059ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
41462024-11-14T17:04:17.059ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab3c0ce5-fbaf-4880-8751-a7e062ad5159", "content-length": "109", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41472024-11-14T17:04:17.059ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
41482024-11-14T17:04:17.060ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "18e0ce62-ec6d-4bdc-9d11-06d3eb6ea04c", "content-length": "109", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41492024-11-14T17:04:17.060ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
41502024-11-14T17:04:17.060ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebda15be-39ba-42fe-8f0e-01ef7ed35799", "content-length": "169", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41512024-11-14T17:04:17.060ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
41522024-11-14T17:04:17.060ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a756be8-50a3-4a02-89a1-8aad9052d4f6", "content-length": "169", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41532024-11-14T17:04:17.060ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
41542024-11-14T17:04:17.061ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc481642-64ad-4263-9eef-61ff6a2524f1", "content-length": "178", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41552024-11-14T17:04:17.061ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
41562024-11-14T17:04:17.061ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "739f0c4f-5101-49e4-ab2f-9862e34f2521", "content-length": "178", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41572024-11-14T17:04:17.061ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
41582024-11-14T17:04:17.061ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8915e880-940a-4e1e-88e4-5b850478c658", "content-length": "702", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41592024-11-14T17:04:17.061ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
41602024-11-14T17:04:17.061ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d51b4f0a-552b-4fd8-ac23-fffe47844548", "content-length": "727", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41612024-11-14T17:04:17.061ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
41622024-11-14T17:04:17.061ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffc7400b-461f-42d4-92cc-1cb9dd125aea", "content-length": "729", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41632024-11-14T17:04:17.061ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
41642024-11-14T17:04:17.062ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e21df9f-c701-4e22-9e1d-4e8d56d31486", "content-length": "728", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41652024-11-14T17:04:17.062ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
41662024-11-14T17:04:17.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
41672024-11-14T17:04:17.065ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
41682024-11-14T17:04:17.065ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41692024-11-14T17:04:17.066ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad293067-c76d-49b3-bd18-3a98435b4201", "content-length": "26", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41702024-11-14T17:04:17.066ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41712024-11-14T17:04:17.067ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41722024-11-14T17:04:17.131ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
41732024-11-14T17:04:17.131ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "17d87890-4485-486a-ab6f-5cd97e20e248", "date": "Thu, 14 Nov 2024 17:04:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41742024-11-14T17:04:17.131ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41752024-11-14T17:04:17.133ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "857a87e3-b2bc-401b-837a-4da56fe1f796", "date": "Thu, 14 Nov 2024 17:04:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41762024-11-14T17:04:17.133ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41772024-11-14T17:04:17.134ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41782024-11-14T17:04:17.134ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 425.285426ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41792024-11-14T17:04:17.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = a3369a26-cb8f-4ca4-b29b-3933c6281c58 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
41802024-11-14T17:04:17.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = a3369a26-cb8f-4ca4-b29b-3933c6281c58 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
41812024-11-14T17:04:17.225ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41822024-11-14T17:04:17.226ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "da70139c-7dd2-4f12-90c2-3ba625423f17", "content-length": "1", "date": "Thu, 14 Nov 2024 17:04:16 GMT"} })
41832024-11-14T17:04:17.228ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41842024-11-14T17:04:17.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41852024-11-14T17:04:17.266ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
41862024-11-14T17:04:17.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dcd493df-7fa9-4a6c-b56f-b205c9bef959 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
41872024-11-14T17:04:17.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dcd493df-7fa9-4a6c-b56f-b205c9bef959 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
41882024-11-14T17:04:17.337ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 627.647101ms iteration = 21 status = {}
41892024-11-14T17:04:17.340ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41902024-11-14T17:04:17.340ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41912024-11-14T17:04:17.340ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "55a32d38-486e-4942-9c78-91e37e257d21", "content-length": "372", "date": "Thu, 14 Nov 2024 17:04:17 GMT"} })
41922024-11-14T17:04:17.340ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41932024-11-14T17:04:17.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41942024-11-14T17:04:17.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41952024-11-14T17:04:17.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41962024-11-14T17:04:17.342ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41972024-11-14T17:04:17.343ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41982024-11-14T17:04:17.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dcd493df-7fa9-4a6c-b56f-b205c9bef959 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
41992024-11-14T17:04:17.345ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 635.641731ms iteration = 21 status = null
42002024-11-14T17:04:17.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210291 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = a3369a26-cb8f-4ca4-b29b-3933c6281c58 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
42012024-11-14T17:04:17.345ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
42022024-11-14T17:04:17.345ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
42032024-11-14T17:04:17.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
42042024-11-14T17:04:17.346ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42052024-11-14T17:04:17.346ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42062024-11-14T17:04:17.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42072024-11-14T17:04:17.348ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42082024-11-14T17:04:17.348ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42092024-11-14T17:04:17.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42102024-11-14T17:04:17.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42112024-11-14T17:04:17.349ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42122024-11-14T17:04:17.350ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
42132024-11-14T17:04:17.350ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
42142024-11-14T17:04:17.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
42152024-11-14T17:04:17.351ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42162024-11-14T17:04:17.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42172024-11-14T17:04:17.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42182024-11-14T17:04:17.353ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
42192024-11-14T17:04:17.353ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42202024-11-14T17:04:17.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42212024-11-14T17:04:17.360ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42222024-11-14T17:04:17.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42232024-11-14T17:04:17.363ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42242024-11-14T17:04:17.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42252024-11-14T17:04:17.366ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42262024-11-14T17:04:17.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42272024-11-14T17:04:17.406ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
42282024-11-14T17:04:17.407ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "114f4b2d-fd24-4a97-b9e6-f7b64dbae2b4", "date": "Thu, 14 Nov 2024 17:04:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42292024-11-14T17:04:17.407ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42302024-11-14T17:04:17.411ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "02fc7bb8-3d8b-448e-874a-8132c0756d9d", "date": "Thu, 14 Nov 2024 17:04:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42312024-11-14T17:04:17.411ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42322024-11-14T17:04:17.412ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
42332024-11-14T17:04:17.412ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
42342024-11-14T17:04:17.414ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8e9810b4-d241-48bb-ba06-8b4f4442425a", "date": "Thu, 14 Nov 2024 17:04:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42352024-11-14T17:04:17.414ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42362024-11-14T17:04:17.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42372024-11-14T17:04:17.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42382024-11-14T17:04:17.416ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42392024-11-14T17:04:17.416ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 707.486842ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
42402024-11-14T17:04:17.417ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6eaef9a7-c084-457d-abae-310ef26f58a7", "date": "Thu, 14 Nov 2024 17:04:17 GMT"} })
42412024-11-14T17:04:17.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42422024-11-14T17:04:17.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42432024-11-14T17:04:17.495ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
42442024-11-14T17:04:17.495ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
42452024-11-14T17:04:17.498ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42462024-11-14T17:04:17.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42472024-11-14T17:04:17.502ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42482024-11-14T17:04:17.503ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9222c53d-e0db-4508-9284-f1e7a7127f55", "content-length": "691", "date": "Thu, 14 Nov 2024 17:04:17 GMT"} })
42492024-11-14T17:04:17.503ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
42502024-11-14T17:04:17.503ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
42512024-11-14T17:04:17.503ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
42522024-11-14T17:04:17.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42532024-11-14T17:04:17.504ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 795.617561ms iteration = 21 status = {}
42542024-11-14T17:04:17.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42552024-11-14T17:04:17.505ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
42562024-11-14T17:04:17.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42572024-11-14T17:04:17.505ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42582024-11-14T17:04:17.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42592024-11-14T17:04:17.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42602024-11-14T17:04:17.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42612024-11-14T17:04:17.507ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42622024-11-14T17:04:17.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42632024-11-14T17:04:17.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42642024-11-14T17:04:17.509ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42652024-11-14T17:04:17.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42662024-11-14T17:04:17.510ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42672024-11-14T17:04:17.511ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
42682024-11-14T17:04:17.511ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42692024-11-14T17:04:17.516ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42702024-11-14T17:04:17.516ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5664b93-0c28-4dc4-915a-6466137d9518", "content-length": "134", "date": "Thu, 14 Nov 2024 17:04:17 GMT"} })
42712024-11-14T17:04:17.516ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
42722024-11-14T17:04:17.516ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
42732024-11-14T17:04:17.516ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
42742024-11-14T17:04:17.516ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42752024-11-14T17:04:17.516ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42762024-11-14T17:04:17.516ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42772024-11-14T17:04:17.516ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42782024-11-14T17:04:17.516ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42792024-11-14T17:04:17.516ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42802024-11-14T17:04:17.516ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42812024-11-14T17:04:17.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42822024-11-14T17:04:17.516ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42832024-11-14T17:04:17.517ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42842024-11-14T17:04:17.517ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
42852024-11-14T17:04:17.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42862024-11-14T17:04:17.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42872024-11-14T17:04:17.517ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42882024-11-14T17:04:17.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42892024-11-14T17:04:17.519ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42902024-11-14T17:04:17.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42912024-11-14T17:04:17.519ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42922024-11-14T17:04:17.519ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdc4636b-e0dd-4a67-abbb-418decd9554d", "content-length": "2", "date": "Thu, 14 Nov 2024 17:04:17 GMT"} })
42932024-11-14T17:04:17.519ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42942024-11-14T17:04:17.519ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7c2d601-5bc7-4804-a68c-4a7ed7268e12", "content-length": "52", "date": "Thu, 14 Nov 2024 17:04:17 GMT"} })
42952024-11-14T17:04:17.519ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
42962024-11-14T17:04:17.519ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42972024-11-14T17:04:17.520ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1aafc5d7-2ca8-4f49-9ab2-05b871d82807", "date": "Thu, 14 Nov 2024 17:04:17 GMT"} })
42982024-11-14T17:04:17.521ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42992024-11-14T17:04:17.522ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 813.015253ms iteration = 22 status = {}
43002024-11-14T17:04:17.524ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
43012024-11-14T17:04:17.524ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43022024-11-14T17:04:17.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43032024-11-14T17:04:17.531ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 30bff459-835e-497d-90ea-b8f3054087c8, kind: Service { id: ce02c1f9-750d-466c-8882-9fa4058550a9 }, name: Name("nexus-ce02c1f9-750d-466c-8882-9fa4058550a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbccdcee-328d-46b4-80f2-6e0f18d211c8, kind: Service { id: 0cc022d1-76d3-4a28-8e75-e8e958faa197 }, name: Name("nexus-0cc022d1-76d3-4a28-8e75-e8e958faa197"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 39])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e712bb0a-d063-491f-bbf4-5dc66991d2fe, kind: Service { id: 2b0034bc-df6c-49bf-ba55-680c74f1cd4c }, name: Name("nexus-2b0034bc-df6c-49bf-ba55-680c74f1cd4c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 214])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 50069af6-9491-4754-9535-843738a189a5, kind: Service { id: cb30b954-f678-488f-bf13-6a751f361b3f }, name: Name("external-dns-cb30b954-f678-488f-bf13-6a751f361b3f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 18])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e993830-3c47-4e8c-8d42-eec7a6d6efc3, kind: Service { id: 94482e71-9503-4d09-b73f-615fbf343a2e }, name: Name("external-dns-94482e71-9503-4d09-b73f-615fbf343a2e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
43042024-11-14T17:04:17.531ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43052024-11-14T17:04:17.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43062024-11-14T17:04:17.533ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43072024-11-14T17:04:17.534ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
43082024-11-14T17:04:17.534ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43092024-11-14T17:04:17.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43102024-11-14T17:04:17.536ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
43112024-11-14T17:04:17.536ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 50069af6-9491-4754-9535-843738a189a5, kind: Service { id: cb30b954-f678-488f-bf13-6a751f361b3f }, name: Name("external-dns-cb30b954-f678-488f-bf13-6a751f361b3f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 18])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e993830-3c47-4e8c-8d42-eec7a6d6efc3, kind: Service { id: 94482e71-9503-4d09-b73f-615fbf343a2e }, name: Name("external-dns-94482e71-9503-4d09-b73f-615fbf343a2e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 30bff459-835e-497d-90ea-b8f3054087c8, kind: Service { id: ce02c1f9-750d-466c-8882-9fa4058550a9 }, name: Name("nexus-ce02c1f9-750d-466c-8882-9fa4058550a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbccdcee-328d-46b4-80f2-6e0f18d211c8, kind: Service { id: 0cc022d1-76d3-4a28-8e75-e8e958faa197 }, name: Name("nexus-0cc022d1-76d3-4a28-8e75-e8e958faa197"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 39])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e712bb0a-d063-491f-bbf4-5dc66991d2fe, kind: Service { id: 2b0034bc-df6c-49bf-ba55-680c74f1cd4c }, name: Name("nexus-2b0034bc-df6c-49bf-ba55-680c74f1cd4c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 214])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
43122024-11-14T17:04:17.536ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
43132024-11-14T17:04:17.590ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: f70fbf74-7489-439f-8ec3-e6e8473a8b43, time_created: 2024-11-14T16:54:41.880543Z, time_modified: 2024-11-14T16:54:41.880543Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
43142024-11-14T17:04:17.590ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
43152024-11-14T17:04:17.590ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43162024-11-14T17:04:17.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43172024-11-14T17:04:17.593ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43182024-11-14T17:04:17.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43192024-11-14T17:04:17.595ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43202024-11-14T17:04:17.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
43212024-11-14T17:04:17.628ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
43222024-11-14T17:04:17.635ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "09f66ff3-16ca-42d5-89ce-ea7c990bb0a7", "date": "Thu, 14 Nov 2024 17:04:17 GMT"} })
43232024-11-14T17:04:17.637ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
43242024-11-14T17:04:17.637ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 928.193192ms
43252024-11-14T17:04:17.637ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 928.204512ms iteration = 3 status = {}
43262024-11-14T17:04:17.814ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6648098e-cd60-4a63-9724-71ded2f2c850", "date": "Thu, 14 Nov 2024 17:04:17 GMT"} })
43272024-11-14T17:04:17.814ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
43282024-11-14T17:04:17.814ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43292024-11-14T17:04:17.819ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "76a7c0e8-de13-4874-9f05-0cca84c4a016", "content-length": "682", "date": "Thu, 14 Nov 2024 17:04:17 GMT"} })
43302024-11-14T17:04:17.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43312024-11-14T17:04:17.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43322024-11-14T17:04:17.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43332024-11-14T17:04:17.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43342024-11-14T17:04:17.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43352024-11-14T17:04:17.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43362024-11-14T17:04:17.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43372024-11-14T17:04:17.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43382024-11-14T17:04:17.835ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 1.126133497s iteration = 21 status = {}
43392024-11-14T17:04:17.934ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "8943185a-d720-47a0-9789-7125a9c01a9a", "content-length": "30762", "date": "Thu, 14 Nov 2024 17:04:17 GMT"} })
43402024-11-14T17:04:17.936ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
43412024-11-14T17:04:17.936ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
43422024-11-14T17:04:17.936ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
43432024-11-14T17:04:17.938ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
43442024-11-14T17:04:17.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
43452024-11-14T17:04:17.943ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43462024-11-14T17:04:17.944ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
43472024-11-14T17:04:17.945ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
43482024-11-14T17:04:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
43492024-11-14T17:04:18.109ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 04fd4c4b-35d0-4cad-919e-7d50cbf501fd file = nexus/db-queries/src/db/datastore/inventory.rs:1000
43502024-11-14T17:04:18.109ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 04fd4c4b-35d0-4cad-919e-7d50cbf501fd time_started = 2024-11-14 17:04:17.056232 UTC
43512024-11-14T17:04:18.109ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.400312094s iteration = 4 status = {"collection_id":"04fd4c4b-35d0-4cad-919e-7d50cbf501fd","time_done":"2024-11-14 17:04:17.936506 UTC","time_started":"2024-11-14 17:04:17.056232 UTC"}
43522024-11-14T17:04:18.109ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
43532024-11-14T17:04:18.109ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43542024-11-14T17:04:18.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43552024-11-14T17:04:18.111ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43562024-11-14T17:04:18.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43572024-11-14T17:04:18.113ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43582024-11-14T17:04:18.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43592024-11-14T17:04:18.116ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43602024-11-14T17:04:18.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43612024-11-14T17:04:18.117ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43622024-11-14T17:04:18.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43632024-11-14T17:04:18.120ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43642024-11-14T17:04:18.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43652024-11-14T17:04:18.153ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 44.015184ms iteration = 25 status = {"physical_disks_added":0}
43662024-11-14T17:04:18.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1509f778-1d6d-4b60-9b0b-c7e16d80fdb0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43672024-11-14T17:04:18.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1509f778-1d6d-4b60-9b0b-c7e16d80fdb0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43682024-11-14T17:04:18.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1509f778-1d6d-4b60-9b0b-c7e16d80fdb0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43692024-11-14T17:04:19.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 860d7347-60b9-4000-aa6f-88c0515dfb11 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43702024-11-14T17:04:19.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 860d7347-60b9-4000-aa6f-88c0515dfb11 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43712024-11-14T17:04:19.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 860d7347-60b9-4000-aa6f-88c0515dfb11 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43722024-11-14T17:04:20.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 29f66505-82c6-4e6b-808f-25a23472cce5 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43732024-11-14T17:04:20.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 29f66505-82c6-4e6b-808f-25a23472cce5 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43742024-11-14T17:04:20.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 29f66505-82c6-4e6b-808f-25a23472cce5 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43752024-11-14T17:04:21.171ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:51859
43762024-11-14T17:04:21.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51859 req_id = 4291c37d-630a-45e6-a966-498b4355aeac roles = RoleSet { roles: {} } uri = /metrics/producers
43772024-11-14T17:04:21.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51859 req_id = 4291c37d-630a-45e6-a966-498b4355aeac resource = Database result = Ok(()) uri = /metrics/producers
43782024-11-14T17:04:21.209ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = 743a3e75-8669-4b5c-90ad-c360bf17cd8e
43792024-11-14T17:04:21.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38301 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51859 req_id = 4291c37d-630a-45e6-a966-498b4355aeac response_code = 201 uri = /metrics/producers
43802024-11-14T17:04:21.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2bcaa76d-c3fc-4c58-9d0c-b8a53a48a0e8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43812024-11-14T17:04:21.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2bcaa76d-c3fc-4c58-9d0c-b8a53a48a0e8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43822024-11-14T17:04:21.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2bcaa76d-c3fc-4c58-9d0c-b8a53a48a0e8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43832024-11-14T17:04:22.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c4dfccdf-4a36-447b-881b-e83a641e2f13 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43842024-11-14T17:04:22.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c4dfccdf-4a36-447b-881b-e83a641e2f13 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43852024-11-14T17:04:22.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c4dfccdf-4a36-447b-881b-e83a641e2f13 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43862024-11-14T17:04:23.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a090efb0-50bd-447d-a41e-3dfcfee3e3a4 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43872024-11-14T17:04:23.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a090efb0-50bd-447d-a41e-3dfcfee3e3a4 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43882024-11-14T17:04:23.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a090efb0-50bd-447d-a41e-3dfcfee3e3a4 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43892024-11-14T17:04:24.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fa84633c-4357-42c3-9e32-5f567fa94250 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43902024-11-14T17:04:24.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fa84633c-4357-42c3-9e32-5f567fa94250 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43912024-11-14T17:04:24.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fa84633c-4357-42c3-9e32-5f567fa94250 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43922024-11-14T17:04:25.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 140ab77d-174f-4b88-a5eb-d675c58457f8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43932024-11-14T17:04:25.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 140ab77d-174f-4b88-a5eb-d675c58457f8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43942024-11-14T17:04:25.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 140ab77d-174f-4b88-a5eb-d675c58457f8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43952024-11-14T17:04:26.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b8a63ade-f0c9-4c24-9fb2-0677df1591de roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43962024-11-14T17:04:26.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b8a63ade-f0c9-4c24-9fb2-0677df1591de resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43972024-11-14T17:04:26.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b8a63ade-f0c9-4c24-9fb2-0677df1591de response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
43982024-11-14T17:04:26.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 30b2bacc-7447-44e4-915f-61bb6fe8da06 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
43992024-11-14T17:04:26.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
44002024-11-14T17:04:26.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44012024-11-14T17:04:26.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
44022024-11-14T17:04:26.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44032024-11-14T17:04:26.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44042024-11-14T17:04:26.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44052024-11-14T17:04:26.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44062024-11-14T17:04:26.712ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44072024-11-14T17:04:26.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44082024-11-14T17:04:26.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44092024-11-14T17:04:26.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44102024-11-14T17:04:26.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44112024-11-14T17:04:26.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44122024-11-14T17:04:26.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44132024-11-14T17:04:26.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44142024-11-14T17:04:26.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
44152024-11-14T17:04:26.720ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44162024-11-14T17:04:26.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44172024-11-14T17:04:26.729ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
44182024-11-14T17:04:26.729ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.725315ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
44192024-11-14T17:04:26.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.637121ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44202024-11-14T17:04:27.151ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:55166
44212024-11-14T17:04:27.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55166 req_id = 20b34997-ff0a-4fbf-9f05-0d89fab86ede roles = RoleSet { roles: {} } uri = /metrics/producers
44222024-11-14T17:04:27.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55166 req_id = 20b34997-ff0a-4fbf-9f05-0d89fab86ede resource = Database result = Ok(()) uri = /metrics/producers
44232024-11-14T17:04:27.193ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = 6bd40b29-f0a0-4b84-a1e1-0a83cff94df0
44242024-11-14T17:04:27.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42301 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55166 req_id = 20b34997-ff0a-4fbf-9f05-0d89fab86ede response_code = 201 uri = /metrics/producers
44252024-11-14T17:04:27.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8fd61bd8-211a-4782-b453-a94a584465b2 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44262024-11-14T17:04:27.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8fd61bd8-211a-4782-b453-a94a584465b2 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44272024-11-14T17:04:27.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8fd61bd8-211a-4782-b453-a94a584465b2 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44282024-11-14T17:04:28.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cedc5f21-dc0f-4651-ac72-d3394797f1ff roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44292024-11-14T17:04:28.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cedc5f21-dc0f-4651-ac72-d3394797f1ff resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44302024-11-14T17:04:28.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cedc5f21-dc0f-4651-ac72-d3394797f1ff response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44312024-11-14T17:04:29.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4c74ffda-cf3f-445b-987d-9c1a11012ba8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44322024-11-14T17:04:29.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4c74ffda-cf3f-445b-987d-9c1a11012ba8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44332024-11-14T17:04:29.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4c74ffda-cf3f-445b-987d-9c1a11012ba8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44342024-11-14T17:04:30.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be5c2d5e-f469-4512-9c11-60611676945c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44352024-11-14T17:04:30.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be5c2d5e-f469-4512-9c11-60611676945c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44362024-11-14T17:04:30.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be5c2d5e-f469-4512-9c11-60611676945c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44372024-11-14T17:04:31.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d25e6074-60aa-4c0d-8544-e1a0e115a5d3 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44382024-11-14T17:04:31.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d25e6074-60aa-4c0d-8544-e1a0e115a5d3 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44392024-11-14T17:04:31.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d25e6074-60aa-4c0d-8544-e1a0e115a5d3 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44402024-11-14T17:04:32.118ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:56335
44412024-11-14T17:04:32.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56335 req_id = 84b443d5-8155-40a0-aff4-70c69e9209d2 roles = RoleSet { roles: {} } uri = /metrics/producers
44422024-11-14T17:04:32.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56335 req_id = 84b443d5-8155-40a0-aff4-70c69e9209d2 resource = Database result = Ok(()) uri = /metrics/producers
44432024-11-14T17:04:32.152ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
44442024-11-14T17:04:32.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33522 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56335 req_id = 84b443d5-8155-40a0-aff4-70c69e9209d2 response_code = 201 uri = /metrics/producers
44452024-11-14T17:04:32.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1e0e05e8-8f11-4b3b-89e3-d11df7bb58dc roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44462024-11-14T17:04:32.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1e0e05e8-8f11-4b3b-89e3-d11df7bb58dc resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44472024-11-14T17:04:32.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1e0e05e8-8f11-4b3b-89e3-d11df7bb58dc response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44482024-11-14T17:04:32.837ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:51554
44492024-11-14T17:04:32.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51554 req_id = 4f53c84b-63da-442c-8af0-b3964d4d66c0 roles = RoleSet { roles: {} } uri = /metrics/producers
44502024-11-14T17:04:32.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51554 req_id = 4f53c84b-63da-442c-8af0-b3964d4d66c0 resource = Database result = Ok(()) uri = /metrics/producers
44512024-11-14T17:04:32.873ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = 96e8c35c-9335-4348-babf-c56b7d06c593
44522024-11-14T17:04:32.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36261 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51554 req_id = 4f53c84b-63da-442c-8af0-b3964d4d66c0 response_code = 201 uri = /metrics/producers
44532024-11-14T17:04:33.491ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:44672
44542024-11-14T17:04:33.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44672 req_id = f69f2b02-3955-4030-903f-663dd851abe8 roles = RoleSet { roles: {} } uri = /metrics/producers
44552024-11-14T17:04:33.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44672 req_id = f69f2b02-3955-4030-903f-663dd851abe8 resource = Database result = Ok(()) uri = /metrics/producers
44562024-11-14T17:04:33.524ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = 973cae68-7270-4bdc-af1f-f9462c2eb9cf
44572024-11-14T17:04:33.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33631 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44672 req_id = f69f2b02-3955-4030-903f-663dd851abe8 response_code = 201 uri = /metrics/producers
44582024-11-14T17:04:33.610ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:58724
44592024-11-14T17:04:33.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58724 req_id = 1af6489b-424b-498d-9544-d71efda07ed4 roles = RoleSet { roles: {} } uri = /metrics/producers
44602024-11-14T17:04:33.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58724 req_id = 1af6489b-424b-498d-9544-d71efda07ed4 resource = Database result = Ok(()) uri = /metrics/producers
44612024-11-14T17:04:33.619ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = cd3068aa-0bb3-4c89-8df3-40f9024907ef
44622024-11-14T17:04:33.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9000 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58724 req_id = 1af6489b-424b-498d-9544-d71efda07ed4 response_code = 201 uri = /metrics/producers
44632024-11-14T17:04:33.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c84529fe-8e23-4ccd-9e29-ee805fac7d1b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44642024-11-14T17:04:33.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c84529fe-8e23-4ccd-9e29-ee805fac7d1b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44652024-11-14T17:04:33.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c84529fe-8e23-4ccd-9e29-ee805fac7d1b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44662024-11-14T17:04:34.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8596141b-4994-4de4-9f4c-40a1e1ef1e03 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44672024-11-14T17:04:34.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8596141b-4994-4de4-9f4c-40a1e1ef1e03 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44682024-11-14T17:04:34.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8596141b-4994-4de4-9f4c-40a1e1ef1e03 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44692024-11-14T17:04:35.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6306c278-ae03-48e6-b3d6-f05af0ad1b21 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44702024-11-14T17:04:35.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6306c278-ae03-48e6-b3d6-f05af0ad1b21 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44712024-11-14T17:04:35.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2557 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6306c278-ae03-48e6-b3d6-f05af0ad1b21 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44722024-11-14T17:04:36.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
44732024-11-14T17:04:36.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
44742024-11-14T17:04:36.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44752024-11-14T17:04:36.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44762024-11-14T17:04:36.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44772024-11-14T17:04:36.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44782024-11-14T17:04:36.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44792024-11-14T17:04:36.711ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44802024-11-14T17:04:36.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44812024-11-14T17:04:36.713ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.165684ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44822024-11-14T17:04:36.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44832024-11-14T17:04:36.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44842024-11-14T17:04:36.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44852024-11-14T17:04:36.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44862024-11-14T17:04:36.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44872024-11-14T17:04:36.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44882024-11-14T17:04:36.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
44892024-11-14T17:04:36.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44902024-11-14T17:04:36.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44912024-11-14T17:04:36.727ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
44922024-11-14T17:04:36.727ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.892266ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
44932024-11-14T17:04:36.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 92c8a07e-933c-4536-8bf5-7d3a2a44f113 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44942024-11-14T17:04:36.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 92c8a07e-933c-4536-8bf5-7d3a2a44f113 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44952024-11-14T17:04:36.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 92c8a07e-933c-4536-8bf5-7d3a2a44f113 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44962024-11-14T17:04:37.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a2f63d3b-bc8b-4396-9d1a-ccfd2fe1850e roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44972024-11-14T17:04:37.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a2f63d3b-bc8b-4396-9d1a-ccfd2fe1850e resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44982024-11-14T17:04:37.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a2f63d3b-bc8b-4396-9d1a-ccfd2fe1850e response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
44992024-11-14T17:04:38.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 96b8bcf2-e7c2-4aad-a532-0053c29e91b6 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45002024-11-14T17:04:38.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 96b8bcf2-e7c2-4aad-a532-0053c29e91b6 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45012024-11-14T17:04:38.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 96b8bcf2-e7c2-4aad-a532-0053c29e91b6 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45022024-11-14T17:04:39.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e61e1386-784b-4403-8eb1-6f466a788253 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45032024-11-14T17:04:39.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e61e1386-784b-4403-8eb1-6f466a788253 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45042024-11-14T17:04:39.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e61e1386-784b-4403-8eb1-6f466a788253 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45052024-11-14T17:04:40.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f0adcc90-3a87-4abb-af25-fae74d1a7b6b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45062024-11-14T17:04:40.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f0adcc90-3a87-4abb-af25-fae74d1a7b6b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45072024-11-14T17:04:40.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f0adcc90-3a87-4abb-af25-fae74d1a7b6b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45082024-11-14T17:04:41.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 41ac90bf-9af6-4f39-b0e6-a7842f3067c5 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
45092024-11-14T17:04:41.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d7f3d327-67ba-4beb-81f7-d94e0dcbc292 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45102024-11-14T17:04:41.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d7f3d327-67ba-4beb-81f7-d94e0dcbc292 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45112024-11-14T17:04:41.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2566 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d7f3d327-67ba-4beb-81f7-d94e0dcbc292 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45122024-11-14T17:04:42.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f67ae0bd-abe5-4136-a1d4-5611817f4f5c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45132024-11-14T17:04:42.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f67ae0bd-abe5-4136-a1d4-5611817f4f5c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45142024-11-14T17:04:42.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f67ae0bd-abe5-4136-a1d4-5611817f4f5c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45152024-11-14T17:04:43.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 80221909-996a-4c71-ad4e-cf12134a5a3c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45162024-11-14T17:04:43.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 80221909-996a-4c71-ad4e-cf12134a5a3c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45172024-11-14T17:04:43.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 80221909-996a-4c71-ad4e-cf12134a5a3c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45182024-11-14T17:04:44.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dc19ac63-89a9-4dec-88aa-0580b952e152 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45192024-11-14T17:04:44.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dc19ac63-89a9-4dec-88aa-0580b952e152 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45202024-11-14T17:04:44.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dc19ac63-89a9-4dec-88aa-0580b952e152 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45212024-11-14T17:04:46.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c22b569f-d2af-4253-bb9c-9afdd83910a8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45222024-11-14T17:04:46.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c22b569f-d2af-4253-bb9c-9afdd83910a8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45232024-11-14T17:04:46.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c22b569f-d2af-4253-bb9c-9afdd83910a8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
45242024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
45252024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45262024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
45272024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
45282024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45292024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45302024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
45312024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
45322024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
45332024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45342024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
45352024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
45362024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45372024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
45382024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45392024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45402024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
45412024-11-14T17:04:46.709ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
45422024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
45432024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45442024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45452024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
45462024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45472024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
45482024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45492024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
45502024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45512024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45522024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45532024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
45542024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
45552024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
45562024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45572024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
45582024-11-14T17:04:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
45592024-11-14T17:04:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
45602024-11-14T17:04:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45612024-11-14T17:04:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45622024-11-14T17:04:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45632024-11-14T17:04:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45642024-11-14T17:04:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
45652024-11-14T17:04:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45662024-11-14T17:04:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45672024-11-14T17:04:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45682024-11-14T17:04:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45692024-11-14T17:04:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45702024-11-14T17:04:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45712024-11-14T17:04:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
45722024-11-14T17:04:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
45732024-11-14T17:04:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45742024-11-14T17:04:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45752024-11-14T17:04:46.711ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45762024-11-14T17:04:46.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45772024-11-14T17:04:46.712ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45782024-11-14T17:04:46.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45792024-11-14T17:04:46.713ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.676543ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
45802024-11-14T17:04:46.713ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45812024-11-14T17:04:46.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45822024-11-14T17:04:46.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45832024-11-14T17:04:46.714ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45842024-11-14T17:04:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45852024-11-14T17:04:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45862024-11-14T17:04:46.715ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45872024-11-14T17:04:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45882024-11-14T17:04:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45892024-11-14T17:04:46.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45902024-11-14T17:04:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45912024-11-14T17:04:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45922024-11-14T17:04:46.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45932024-11-14T17:04:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45942024-11-14T17:04:46.717ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2410, tv_nsec: 446606140 } })
45952024-11-14T17:04:46.717ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
45962024-11-14T17:04:46.718ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45972024-11-14T17:04:46.720ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45982024-11-14T17:04:46.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45992024-11-14T17:04:46.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46002024-11-14T17:04:46.723ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.780661ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
46012024-11-14T17:04:46.724ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2410, tv_nsec: 453386793 } })
46022024-11-14T17:04:46.724ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
46032024-11-14T17:04:46.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46042024-11-14T17:04:46.726ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46052024-11-14T17:04:46.726ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
46062024-11-14T17:04:46.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46072024-11-14T17:04:46.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46082024-11-14T17:04:46.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46092024-11-14T17:04:46.728ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46102024-11-14T17:04:46.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46112024-11-14T17:04:46.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.28014ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46122024-11-14T17:04:46.731ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46132024-11-14T17:04:46.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46142024-11-14T17:04:46.732ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46152024-11-14T17:04:46.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46162024-11-14T17:04:46.733ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46172024-11-14T17:04:46.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46182024-11-14T17:04:46.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46192024-11-14T17:04:46.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46202024-11-14T17:04:46.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46212024-11-14T17:04:46.735ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46222024-11-14T17:04:46.735ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2410, tv_nsec: 464994235 } })
46232024-11-14T17:04:46.736ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
46242024-11-14T17:04:46.736ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46252024-11-14T17:04:46.736ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
46262024-11-14T17:04:46.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46272024-11-14T17:04:46.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46282024-11-14T17:04:46.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46292024-11-14T17:04:46.738ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46302024-11-14T17:04:46.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46312024-11-14T17:04:46.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46322024-11-14T17:04:46.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46332024-11-14T17:04:46.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46342024-11-14T17:04:46.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46352024-11-14T17:04:46.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
46362024-11-14T17:04:46.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46372024-11-14T17:04:46.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46382024-11-14T17:04:46.775ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46392024-11-14T17:04:46.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46402024-11-14T17:04:46.777ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46412024-11-14T17:04:46.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46422024-11-14T17:04:46.778ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
46432024-11-14T17:04:46.778ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.065828ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
46442024-11-14T17:04:46.778ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46452024-11-14T17:04:46.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46462024-11-14T17:04:46.781ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46472024-11-14T17:04:46.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46482024-11-14T17:04:46.783ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.412667ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
46492024-11-14T17:04:46.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 75.469863ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
46502024-11-14T17:04:46.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46512024-11-14T17:04:46.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46522024-11-14T17:04:46.792ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
46532024-11-14T17:04:46.792ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.971302ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
46542024-11-14T17:04:46.792ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 83.486624ms iteration = 26 status = {"physical_disks_added":0}
46552024-11-14T17:04:46.794ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46562024-11-14T17:04:46.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46572024-11-14T17:04:46.796ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46582024-11-14T17:04:46.797ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46592024-11-14T17:04:46.797ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46602024-11-14T17:04:46.797ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 88.291892ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46612024-11-14T17:04:46.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
46622024-11-14T17:04:46.798ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46632024-11-14T17:04:46.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46642024-11-14T17:04:46.800ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 91.267049ms iteration = 22 status = 0
46652024-11-14T17:04:46.805ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
46662024-11-14T17:04:46.805ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46672024-11-14T17:04:46.805ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c58b9f4-71ed-4af4-901e-2ee2bf3e3a22", "content-length": "26", "date": "Thu, 14 Nov 2024 17:04:46 GMT"} })
46682024-11-14T17:04:46.805ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46692024-11-14T17:04:46.808ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46702024-11-14T17:04:46.811ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.199186ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46712024-11-14T17:04:46.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.380313ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
46722024-11-14T17:04:46.839ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
46732024-11-14T17:04:46.839ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46742024-11-14T17:04:46.840ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad45354d-d051-4791-bad1-6fd2109aeff5", "content-length": "26", "date": "Thu, 14 Nov 2024 17:04:46 GMT"} })
46752024-11-14T17:04:46.840ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46762024-11-14T17:04:46.841ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
46772024-11-14T17:04:46.841ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46782024-11-14T17:04:46.841ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "713b1f82-b120-40a7-95e6-6134c1ff1b5a", "content-length": "26", "date": "Thu, 14 Nov 2024 17:04:46 GMT"} })
46792024-11-14T17:04:46.841ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46802024-11-14T17:04:46.842ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46812024-11-14T17:04:46.845ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
46822024-11-14T17:04:46.879ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46832024-11-14T17:04:46.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46842024-11-14T17:04:46.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46852024-11-14T17:04:46.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46862024-11-14T17:04:46.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46872024-11-14T17:04:46.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46882024-11-14T17:04:46.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46892024-11-14T17:04:46.888ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46902024-11-14T17:04:46.888ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46912024-11-14T17:04:46.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46922024-11-14T17:04:47.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0d25fffd-763e-4b8c-986d-d3abcc513e39 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
46932024-11-14T17:04:47.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0d25fffd-763e-4b8c-986d-d3abcc513e39 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
46942024-11-14T17:04:47.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2717 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0d25fffd-763e-4b8c-986d-d3abcc513e39 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
46952024-11-14T17:04:47.034ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 325.503004ms iteration = 22 status = {}
46962024-11-14T17:04:47.065ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46972024-11-14T17:04:47.065ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "db9bbafd-c755-40e5-91dc-802e89a3d6e2", "content-length": "1", "date": "Thu, 14 Nov 2024 17:04:46 GMT"} })
46982024-11-14T17:04:47.067ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46992024-11-14T17:04:47.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47002024-11-14T17:04:47.069ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
47012024-11-14T17:04:47.069ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47022024-11-14T17:04:47.070ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "180659e6-af2c-4df3-9eee-c991100eecb2", "content-length": "372", "date": "Thu, 14 Nov 2024 17:04:47 GMT"} })
47032024-11-14T17:04:47.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47042024-11-14T17:04:47.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47052024-11-14T17:04:47.071ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 362.282183ms iteration = 22 status = null
47062024-11-14T17:04:47.088ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
47072024-11-14T17:04:47.088ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
47082024-11-14T17:04:47.088ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "62a61ded-4d76-45f4-889e-ba837a184b24", "date": "Thu, 14 Nov 2024 17:04:47 GMT"} })
47092024-11-14T17:04:47.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47102024-11-14T17:04:47.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47112024-11-14T17:04:47.096ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47122024-11-14T17:04:47.096ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "48de704b-8d95-4cdd-94b2-e1eb7d7548f2", "content-length": "691", "date": "Thu, 14 Nov 2024 17:04:47 GMT"} })
47132024-11-14T17:04:47.096ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
47142024-11-14T17:04:47.096ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
47152024-11-14T17:04:47.096ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
47162024-11-14T17:04:47.098ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 388.829233ms iteration = 22 status = {}
47172024-11-14T17:04:47.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47182024-11-14T17:04:47.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47192024-11-14T17:04:47.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47202024-11-14T17:04:47.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47212024-11-14T17:04:47.104ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
47222024-11-14T17:04:47.104ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47232024-11-14T17:04:47.136ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47242024-11-14T17:04:47.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47252024-11-14T17:04:47.139ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
47262024-11-14T17:04:47.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47272024-11-14T17:04:47.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47282024-11-14T17:04:47.146ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
47292024-11-14T17:04:47.146ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "68431f8d-c669-4c5d-abbe-c31ab235a82e", "content-length": "134", "date": "Thu, 14 Nov 2024 17:04:46 GMT"} })
47302024-11-14T17:04:47.146ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
47312024-11-14T17:04:47.146ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
47322024-11-14T17:04:47.147ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
47332024-11-14T17:04:47.147ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
47342024-11-14T17:04:47.147ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47352024-11-14T17:04:47.147ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47362024-11-14T17:04:47.147ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47372024-11-14T17:04:47.147ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47382024-11-14T17:04:47.147ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47392024-11-14T17:04:47.147ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47402024-11-14T17:04:47.147ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
47412024-11-14T17:04:47.147ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47422024-11-14T17:04:47.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47432024-11-14T17:04:47.149ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
47442024-11-14T17:04:47.149ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "50929993-9227-42a7-bbf6-f5c8c02f3bf8", "content-length": "2", "date": "Thu, 14 Nov 2024 17:04:46 GMT"} })
47452024-11-14T17:04:47.149ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
47462024-11-14T17:04:47.149ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d9ace99-7958-484f-a8d8-ff8a454ff0ca", "content-length": "52", "date": "Thu, 14 Nov 2024 17:04:46 GMT"} })
47472024-11-14T17:04:47.149ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
47482024-11-14T17:04:47.149ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
47492024-11-14T17:04:47.214ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "71869618-40bc-43ba-b246-8799c13e6c1c", "date": "Thu, 14 Nov 2024 17:04:47 GMT"} })
47502024-11-14T17:04:47.216ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 507.03977ms iteration = 23 status = {}
47512024-11-14T17:04:47.311ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1e40d833-7bb0-4510-b1a1-1ba65ea63fa0", "date": "Thu, 14 Nov 2024 17:04:47 GMT"} })
47522024-11-14T17:04:47.311ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
47532024-11-14T17:04:47.311ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47542024-11-14T17:04:47.315ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "54df17b9-d891-4d36-a5b6-21dac1366dbf", "content-length": "682", "date": "Thu, 14 Nov 2024 17:04:47 GMT"} })
47552024-11-14T17:04:47.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47562024-11-14T17:04:47.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47572024-11-14T17:04:47.319ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47582024-11-14T17:04:47.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47592024-11-14T17:04:47.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47602024-11-14T17:04:47.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47612024-11-14T17:04:47.326ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47622024-11-14T17:04:47.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47632024-11-14T17:04:47.333ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 623.981538ms iteration = 22 status = {}
47642024-11-14T17:04:47.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = fb90211f-ffe9-43f8-9bc2-51f97ae06305 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
47652024-11-14T17:04:47.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = fb90211f-ffe9-43f8-9bc2-51f97ae06305 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
47662024-11-14T17:04:47.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = fb90211f-ffe9-43f8-9bc2-51f97ae06305 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
47672024-11-14T17:04:48.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b7098b43-4f9f-41fd-8474-2149a0fffd7c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47682024-11-14T17:04:48.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b7098b43-4f9f-41fd-8474-2149a0fffd7c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47692024-11-14T17:04:48.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b7098b43-4f9f-41fd-8474-2149a0fffd7c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47702024-11-14T17:04:48.878ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
47712024-11-14T17:04:48.878ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
47722024-11-14T17:04:48.908ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
47732024-11-14T17:04:48.909ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:50859
47742024-11-14T17:04:48.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50859 req_id = a7ad6a1c-df7e-4dcb-9cc6-9b03cb08028e roles = RoleSet { roles: {} } uri = /metrics/producers
47752024-11-14T17:04:48.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50859 req_id = a7ad6a1c-df7e-4dcb-9cc6-9b03cb08028e resource = Database result = Ok(()) uri = /metrics/producers
47762024-11-14T17:04:48.919ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
47772024-11-14T17:04:48.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10087 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50859 req_id = a7ad6a1c-df7e-4dcb-9cc6-9b03cb08028e response_code = 201 uri = /metrics/producers
47782024-11-14T17:04:48.919ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "a7ad6a1c-df7e-4dcb-9cc6-9b03cb08028e", "content-length": "41", "date": "Thu, 14 Nov 2024 17:04:48 GMT"} })
47792024-11-14T17:04:48.920ZDEBGnexus (producer-registration-task): registered with nexus successfully
47802024-11-14T17:04:48.920ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
47812024-11-14T17:04:49.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 69749bc2-813d-4de8-aafe-59255b820cbd roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47822024-11-14T17:04:49.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 69749bc2-813d-4de8-aafe-59255b820cbd resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47832024-11-14T17:04:49.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1702 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 69749bc2-813d-4de8-aafe-59255b820cbd response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47842024-11-14T17:04:50.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f8567426-37f3-419b-bc93-91b06f10f35c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47852024-11-14T17:04:50.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f8567426-37f3-419b-bc93-91b06f10f35c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47862024-11-14T17:04:50.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f8567426-37f3-419b-bc93-91b06f10f35c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47872024-11-14T17:04:51.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = eb3a36e5-5194-47e2-9ae1-b088cdec97b8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47882024-11-14T17:04:51.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = eb3a36e5-5194-47e2-9ae1-b088cdec97b8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47892024-11-14T17:04:51.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = eb3a36e5-5194-47e2-9ae1-b088cdec97b8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47902024-11-14T17:04:52.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 46f4baff-b30c-46c9-851a-4b59b4dcca31 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47912024-11-14T17:04:52.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 46f4baff-b30c-46c9-851a-4b59b4dcca31 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47922024-11-14T17:04:52.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 46f4baff-b30c-46c9-851a-4b59b4dcca31 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47932024-11-14T17:04:53.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 928c9e01-1c2c-4ea2-b56d-c46dc5a52c3a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47942024-11-14T17:04:53.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 928c9e01-1c2c-4ea2-b56d-c46dc5a52c3a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47952024-11-14T17:04:53.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 928c9e01-1c2c-4ea2-b56d-c46dc5a52c3a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47962024-11-14T17:04:54.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7e2a595a-869c-4281-9df7-e134637f8f41 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47972024-11-14T17:04:54.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7e2a595a-869c-4281-9df7-e134637f8f41 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47982024-11-14T17:04:54.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7e2a595a-869c-4281-9df7-e134637f8f41 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
47992024-11-14T17:04:55.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fbb5f56f-c0a4-441f-872f-bfaf76620d64 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48002024-11-14T17:04:55.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fbb5f56f-c0a4-441f-872f-bfaf76620d64 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48012024-11-14T17:04:55.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fbb5f56f-c0a4-441f-872f-bfaf76620d64 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48022024-11-14T17:04:56.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b9579348-3a6d-4e53-9767-19f5adaf7778 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48032024-11-14T17:04:56.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b9579348-3a6d-4e53-9767-19f5adaf7778 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48042024-11-14T17:04:56.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b9579348-3a6d-4e53-9767-19f5adaf7778 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48052024-11-14T17:04:56.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1632 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = c76adcda-3939-4b4e-860a-bde075262ef3 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
48062024-11-14T17:04:56.708ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
48072024-11-14T17:04:56.708ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
48082024-11-14T17:04:56.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48092024-11-14T17:04:56.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48102024-11-14T17:04:56.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48112024-11-14T17:04:56.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48122024-11-14T17:04:56.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48132024-11-14T17:04:56.711ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48142024-11-14T17:04:56.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48152024-11-14T17:04:56.713ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.136053ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48162024-11-14T17:04:56.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48172024-11-14T17:04:56.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48182024-11-14T17:04:56.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48192024-11-14T17:04:56.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48202024-11-14T17:04:56.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48212024-11-14T17:04:56.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48222024-11-14T17:04:56.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
48232024-11-14T17:04:56.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48242024-11-14T17:04:56.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48252024-11-14T17:04:56.734ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
48262024-11-14T17:04:56.734ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.981057ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
48272024-11-14T17:04:57.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 42084d25-8c6a-4ec3-bd83-a575961a9359 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48282024-11-14T17:04:57.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 42084d25-8c6a-4ec3-bd83-a575961a9359 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48292024-11-14T17:04:57.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 42084d25-8c6a-4ec3-bd83-a575961a9359 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48302024-11-14T17:04:58.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8dc62059-273e-4951-86a6-f7937a74636d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48312024-11-14T17:04:58.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8dc62059-273e-4951-86a6-f7937a74636d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48322024-11-14T17:04:58.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8dc62059-273e-4951-86a6-f7937a74636d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48332024-11-14T17:04:59.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 41681333-c494-430c-b1e3-0b96a83dffbe roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48342024-11-14T17:04:59.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 41681333-c494-430c-b1e3-0b96a83dffbe resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48352024-11-14T17:04:59.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 41681333-c494-430c-b1e3-0b96a83dffbe response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48362024-11-14T17:05:00.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b00e4bee-c5ea-4c78-96c4-86c49cb3e7c2 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48372024-11-14T17:05:00.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b00e4bee-c5ea-4c78-96c4-86c49cb3e7c2 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48382024-11-14T17:05:00.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b00e4bee-c5ea-4c78-96c4-86c49cb3e7c2 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48392024-11-14T17:05:01.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ce8f5f44-d5b3-49d4-b589-de731d0ad3b4 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48402024-11-14T17:05:01.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ce8f5f44-d5b3-49d4-b589-de731d0ad3b4 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48412024-11-14T17:05:01.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ce8f5f44-d5b3-49d4-b589-de731d0ad3b4 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48422024-11-14T17:05:02.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 94bbd9fd-6c6e-4e9e-8445-940db34a294a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48432024-11-14T17:05:02.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 94bbd9fd-6c6e-4e9e-8445-940db34a294a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48442024-11-14T17:05:02.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 94bbd9fd-6c6e-4e9e-8445-940db34a294a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48452024-11-14T17:05:03.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cd5bf58c-13c8-4256-996f-932e0101c6d9 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48462024-11-14T17:05:03.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cd5bf58c-13c8-4256-996f-932e0101c6d9 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48472024-11-14T17:05:03.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cd5bf58c-13c8-4256-996f-932e0101c6d9 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48482024-11-14T17:05:04.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f5572eef-dd44-4bae-94e7-f79ca571be95 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48492024-11-14T17:05:04.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f5572eef-dd44-4bae-94e7-f79ca571be95 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48502024-11-14T17:05:04.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f5572eef-dd44-4bae-94e7-f79ca571be95 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48512024-11-14T17:05:05.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3b393a93-b09f-47d9-a5ce-4ebcbff22ea4 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48522024-11-14T17:05:05.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3b393a93-b09f-47d9-a5ce-4ebcbff22ea4 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48532024-11-14T17:05:05.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3b393a93-b09f-47d9-a5ce-4ebcbff22ea4 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48542024-11-14T17:05:06.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0ddad14f-2f5d-4a44-882e-242e9f559f83 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48552024-11-14T17:05:06.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0ddad14f-2f5d-4a44-882e-242e9f559f83 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48562024-11-14T17:05:06.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0ddad14f-2f5d-4a44-882e-242e9f559f83 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48572024-11-14T17:05:06.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
48582024-11-14T17:05:06.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
48592024-11-14T17:05:06.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48602024-11-14T17:05:06.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48612024-11-14T17:05:06.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48622024-11-14T17:05:06.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48632024-11-14T17:05:06.711ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48642024-11-14T17:05:06.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48652024-11-14T17:05:06.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48662024-11-14T17:05:06.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48672024-11-14T17:05:06.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48682024-11-14T17:05:06.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48692024-11-14T17:05:06.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48702024-11-14T17:05:06.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48712024-11-14T17:05:06.720ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48722024-11-14T17:05:06.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
48732024-11-14T17:05:06.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48742024-11-14T17:05:06.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48752024-11-14T17:05:06.732ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
48762024-11-14T17:05:06.732ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.689875ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
48772024-11-14T17:05:06.746ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.075006ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48782024-11-14T17:05:07.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 79d34859-a7db-4158-824e-9512192f21af roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48792024-11-14T17:05:07.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 79d34859-a7db-4158-824e-9512192f21af resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48802024-11-14T17:05:07.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 79d34859-a7db-4158-824e-9512192f21af response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48812024-11-14T17:05:08.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 529138c7-0565-45e2-88e4-f9774132fcad roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48822024-11-14T17:05:08.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 529138c7-0565-45e2-88e4-f9774132fcad resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48832024-11-14T17:05:08.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 529138c7-0565-45e2-88e4-f9774132fcad response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48842024-11-14T17:05:09.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4ff83ef4-98fe-4ced-b22b-2697c493d7a6 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48852024-11-14T17:05:09.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4ff83ef4-98fe-4ced-b22b-2697c493d7a6 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48862024-11-14T17:05:09.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2692 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4ff83ef4-98fe-4ced-b22b-2697c493d7a6 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48872024-11-14T17:05:10.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a0515646-925d-40cc-8914-6777e780f6c3 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48882024-11-14T17:05:10.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a0515646-925d-40cc-8914-6777e780f6c3 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48892024-11-14T17:05:10.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1819 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a0515646-925d-40cc-8914-6777e780f6c3 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48902024-11-14T17:05:11.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 21bc499d-6d7e-4b08-ad66-d48b196749ee roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48912024-11-14T17:05:11.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 21bc499d-6d7e-4b08-ad66-d48b196749ee resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48922024-11-14T17:05:11.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 21bc499d-6d7e-4b08-ad66-d48b196749ee response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48932024-11-14T17:05:11.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1851 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = f982bf71-8da5-49b6-a044-2d57fad851f2 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
48942024-11-14T17:05:12.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f36c2efe-df0a-462e-84f0-49094327c2c6 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48952024-11-14T17:05:12.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f36c2efe-df0a-462e-84f0-49094327c2c6 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48962024-11-14T17:05:12.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f36c2efe-df0a-462e-84f0-49094327c2c6 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48972024-11-14T17:05:13.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fb1bf762-bc25-4b7b-b02f-e52eed050df8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48982024-11-14T17:05:13.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fb1bf762-bc25-4b7b-b02f-e52eed050df8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
48992024-11-14T17:05:13.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fb1bf762-bc25-4b7b-b02f-e52eed050df8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
49002024-11-14T17:05:14.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d5ccb474-dea7-4db6-840e-3243da1994e5 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
49012024-11-14T17:05:14.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d5ccb474-dea7-4db6-840e-3243da1994e5 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
49022024-11-14T17:05:14.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d5ccb474-dea7-4db6-840e-3243da1994e5 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
49032024-11-14T17:05:15.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1a46a44d-31b5-47cd-8cec-427e2a032d2f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
49042024-11-14T17:05:15.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1a46a44d-31b5-47cd-8cec-427e2a032d2f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
49052024-11-14T17:05:15.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1a46a44d-31b5-47cd-8cec-427e2a032d2f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
49062024-11-14T17:05:16.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e2a4df3e-036e-4f75-89b8-052e9d6495b2 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
49072024-11-14T17:05:16.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e2a4df3e-036e-4f75-89b8-052e9d6495b2 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
49082024-11-14T17:05:16.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e2a4df3e-036e-4f75-89b8-052e9d6495b2 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
49092024-11-14T17:05:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
49102024-11-14T17:05:16.709ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
49112024-11-14T17:05:16.709ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
49122024-11-14T17:05:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49132024-11-14T17:05:16.709ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49142024-11-14T17:05:16.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49152024-11-14T17:05:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
49162024-11-14T17:05:16.709ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
49172024-11-14T17:05:16.709ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
49182024-11-14T17:05:16.709ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 16:55:16.709944917 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
49192024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
49202024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49212024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
49222024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
49232024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49242024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
49252024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
49262024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49272024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
49282024-11-14T17:05:16.710ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5
49292024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
49302024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.921\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5"}
49312024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49322024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
49332024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
49342024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
49352024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
49362024-11-14T17:05:16.710ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
49372024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49382024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49392024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
49402024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49412024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
49422024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
49432024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49442024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49452024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
49462024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
49472024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
49482024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49492024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
49502024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
49512024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
49522024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
49532024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
49542024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49552024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49562024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
49572024-11-14T17:05:16.710ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49582024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
49592024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49602024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
49612024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49622024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49632024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49642024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
49652024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49662024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
49672024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
49682024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
49692024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49702024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
49712024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
49722024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
49732024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49742024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49752024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49762024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49772024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49782024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49792024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49802024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49812024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49822024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49832024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49842024-11-14T17:05:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49852024-11-14T17:05:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49862024-11-14T17:05:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
49872024-11-14T17:05:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49882024-11-14T17:05:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49892024-11-14T17:05:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
49902024-11-14T17:05:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49912024-11-14T17:05:16.711ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94482e71-9503-4d09-b73f-615fbf343a2e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2440, tv_nsec: 439966052 } })
49922024-11-14T17:05:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49932024-11-14T17:05:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49942024-11-14T17:05:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49952024-11-14T17:05:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49962024-11-14T17:05:16.711ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89b01be2-c37f-445d-addd-6b4be9cd73c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc5fdca1-6d92-4ff4-b5ae-2f44553a2186.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2440, tv_nsec: 440177667 } })
49972024-11-14T17:05:16.711ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
49982024-11-14T17:05:16.711ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.463823ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
49992024-11-14T17:05:16.711ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
50002024-11-14T17:05:16.711ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.32997ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
50012024-11-14T17:05:16.712ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50022024-11-14T17:05:16.713ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 16:55:16.709944917 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
50032024-11-14T17:05:16.713ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.613592ms iteration = 12 status = {"expiration":"2024-11-14T16:55:16.709944917Z","pruned":[]}
50042024-11-14T17:05:16.713ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50052024-11-14T17:05:16.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50062024-11-14T17:05:16.714ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.350999ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
50072024-11-14T17:05:16.714ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
50082024-11-14T17:05:16.714ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50092024-11-14T17:05:16.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50102024-11-14T17:05:16.715ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50112024-11-14T17:05:16.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50122024-11-14T17:05:16.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50132024-11-14T17:05:16.717ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50142024-11-14T17:05:16.717ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.180942ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
50152024-11-14T17:05:16.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
50162024-11-14T17:05:16.719ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50172024-11-14T17:05:16.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50182024-11-14T17:05:16.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
50192024-11-14T17:05:16.720ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50202024-11-14T17:05:16.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50212024-11-14T17:05:16.722ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50222024-11-14T17:05:16.723ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2440, tv_nsec: 452708039 } })
50232024-11-14T17:05:16.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50242024-11-14T17:05:16.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50252024-11-14T17:05:16.723ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
50262024-11-14T17:05:16.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50272024-11-14T17:05:16.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50282024-11-14T17:05:16.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50292024-11-14T17:05:16.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.415975ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
50302024-11-14T17:05:16.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50312024-11-14T17:05:16.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50322024-11-14T17:05:16.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50332024-11-14T17:05:16.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50342024-11-14T17:05:16.726ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
50352024-11-14T17:05:16.726ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
50362024-11-14T17:05:16.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50372024-11-14T17:05:16.726ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 15.894439ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
50382024-11-14T17:05:16.726ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50392024-11-14T17:05:16.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50402024-11-14T17:05:16.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50412024-11-14T17:05:16.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50422024-11-14T17:05:16.727ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.146486ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
50432024-11-14T17:05:16.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50442024-11-14T17:05:16.730ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50452024-11-14T17:05:16.730ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50462024-11-14T17:05:16.730ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50472024-11-14T17:05:16.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50482024-11-14T17:05:16.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50492024-11-14T17:05:16.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50502024-11-14T17:05:16.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50512024-11-14T17:05:16.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50522024-11-14T17:05:16.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50532024-11-14T17:05:16.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50542024-11-14T17:05:16.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50552024-11-14T17:05:16.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50562024-11-14T17:05:16.732ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2440, tv_nsec: 461325634 } })
50572024-11-14T17:05:16.732ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
50582024-11-14T17:05:16.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50592024-11-14T17:05:16.734ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50602024-11-14T17:05:16.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50612024-11-14T17:05:16.734ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50622024-11-14T17:05:16.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50632024-11-14T17:05:16.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50642024-11-14T17:05:16.738ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50652024-11-14T17:05:16.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50662024-11-14T17:05:16.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50672024-11-14T17:05:16.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50682024-11-14T17:05:16.741ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50692024-11-14T17:05:16.741ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50702024-11-14T17:05:16.741ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50712024-11-14T17:05:16.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50722024-11-14T17:05:16.745ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
50732024-11-14T17:05:16.745ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
50742024-11-14T17:05:16.745ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
50752024-11-14T17:05:16.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50762024-11-14T17:05:16.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50772024-11-14T17:05:16.745ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50782024-11-14T17:05:16.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50792024-11-14T17:05:16.748ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50802024-11-14T17:05:16.749ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50812024-11-14T17:05:16.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
50822024-11-14T17:05:16.753ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50832024-11-14T17:05:16.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50842024-11-14T17:05:16.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50852024-11-14T17:05:16.753ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50862024-11-14T17:05:16.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50872024-11-14T17:05:16.754ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50882024-11-14T17:05:16.754ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 43.964592ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50892024-11-14T17:05:16.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50902024-11-14T17:05:16.765ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50912024-11-14T17:05:16.765ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50922024-11-14T17:05:16.765ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 54.239394ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50932024-11-14T17:05:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50942024-11-14T17:05:16.766ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50952024-11-14T17:05:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50962024-11-14T17:05:16.768ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50972024-11-14T17:05:16.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50982024-11-14T17:05:16.769ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
50992024-11-14T17:05:16.769ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
51002024-11-14T17:05:16.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51012024-11-14T17:05:16.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51022024-11-14T17:05:16.770ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51032024-11-14T17:05:16.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51042024-11-14T17:05:16.773ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51052024-11-14T17:05:16.773ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 63.730248ms iteration = 27 status = {"physical_disks_added":0}
51062024-11-14T17:05:16.775ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51072024-11-14T17:05:16.775ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51082024-11-14T17:05:16.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51092024-11-14T17:05:16.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51102024-11-14T17:05:16.777ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51112024-11-14T17:05:16.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51122024-11-14T17:05:16.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
51132024-11-14T17:05:16.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51142024-11-14T17:05:16.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51152024-11-14T17:05:16.781ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
51162024-11-14T17:05:16.781ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
51172024-11-14T17:05:16.781ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 16:54:46.198050 UTC dns_group = internal generation = 1
51182024-11-14T17:05:16.781ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 72.041925ms iteration = 13 status = {"generation":1}
51192024-11-14T17:05:16.788ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51202024-11-14T17:05:16.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51212024-11-14T17:05:16.793ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.132826ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51222024-11-14T17:05:16.793ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
51232024-11-14T17:05:16.793ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
51242024-11-14T17:05:16.793ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 83.466504ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
51252024-11-14T17:05:16.793ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2440, tv_nsec: 522836282 } })
51262024-11-14T17:05:16.794ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
51272024-11-14T17:05:16.800ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51282024-11-14T17:05:16.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51292024-11-14T17:05:16.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51302024-11-14T17:05:16.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 93.538761ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51312024-11-14T17:05:16.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.694254ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
51322024-11-14T17:05:16.805ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51332024-11-14T17:05:16.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51342024-11-14T17:05:16.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51352024-11-14T17:05:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51362024-11-14T17:05:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
51372024-11-14T17:05:16.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51382024-11-14T17:05:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51392024-11-14T17:05:16.807ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
51402024-11-14T17:05:16.807ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
51412024-11-14T17:05:16.807ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
51422024-11-14T17:05:16.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51432024-11-14T17:05:16.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51442024-11-14T17:05:16.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51452024-11-14T17:05:16.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51462024-11-14T17:05:16.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51472024-11-14T17:05:16.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51482024-11-14T17:05:16.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51492024-11-14T17:05:16.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51502024-11-14T17:05:16.813ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
51512024-11-14T17:05:16.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51522024-11-14T17:05:16.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51532024-11-14T17:05:16.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
51542024-11-14T17:05:16.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51552024-11-14T17:05:16.815ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
51562024-11-14T17:05:16.815ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 105.819318ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
51572024-11-14T17:05:16.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
51582024-11-14T17:05:16.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51592024-11-14T17:05:16.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51602024-11-14T17:05:16.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51612024-11-14T17:05:16.817ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
51622024-11-14T17:05:16.817ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 107.528456ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
51632024-11-14T17:05:16.819ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51642024-11-14T17:05:16.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51652024-11-14T17:05:16.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51662024-11-14T17:05:16.830ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51672024-11-14T17:05:16.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51682024-11-14T17:05:16.836ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T16:54:14.392760Z, time_modified: 2024-11-14T16:54:14.392760Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }) }
51692024-11-14T17:05:16.836ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 126.827262ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]}},"default_endpoint":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
51702024-11-14T17:05:16.850ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
51712024-11-14T17:05:16.850ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 0 version = 2
51722024-11-14T17:05:16.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51732024-11-14T17:05:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51742024-11-14T17:05:16.954ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
51752024-11-14T17:05:16.983ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
51762024-11-14T17:05:16.998ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
51772024-11-14T17:05:16.998ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51782024-11-14T17:05:16.998ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "186763ca-d162-4497-bba7-38adaec3aa3b", "content-length": "26", "date": "Thu, 14 Nov 2024 17:05:16 GMT"} })
51792024-11-14T17:05:16.998ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51802024-11-14T17:05:16.998ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51812024-11-14T17:05:16.998ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51822024-11-14T17:05:16.999ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "29266f95-d864-4f3b-8e57-1b497bea43eb", "content-length": "372", "date": "Thu, 14 Nov 2024 17:05:16 GMT"} })
51832024-11-14T17:05:16.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51842024-11-14T17:05:16.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51852024-11-14T17:05:17.000ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
51862024-11-14T17:05:17.001ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 291.66129ms iteration = 23 status = 0
51872024-11-14T17:05:17.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51882024-11-14T17:05:17.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51892024-11-14T17:05:17.004ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51902024-11-14T17:05:17.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51912024-11-14T17:05:17.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51922024-11-14T17:05:17.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51932024-11-14T17:05:17.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51942024-11-14T17:05:17.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51952024-11-14T17:05:17.013ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 1 version = 2
51962024-11-14T17:05:17.013ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
51972024-11-14T17:05:17.013ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 16:54:47.468912 UTC dns_group = external generation = 2
51982024-11-14T17:05:17.013ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 303.666751ms iteration = 13 status = {"generation":2}
51992024-11-14T17:05:17.042ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 331.735015ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
52002024-11-14T17:05:17.051ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
52012024-11-14T17:05:17.051ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52022024-11-14T17:05:17.052ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b442e30a-bc66-4e9c-9097-da3c1aa70d7d", "content-length": "26", "date": "Thu, 14 Nov 2024 17:05:16 GMT"} })
52032024-11-14T17:05:17.052ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52042024-11-14T17:05:17.053ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52052024-11-14T17:05:17.059ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
52062024-11-14T17:05:17.059ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52072024-11-14T17:05:17.059ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2eb3bc12-11c2-4bfd-a214-da82a418bf36", "content-length": "26", "date": "Thu, 14 Nov 2024 17:05:16 GMT"} })
52082024-11-14T17:05:17.059ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52092024-11-14T17:05:17.060ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
52102024-11-14T17:05:17.060ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
52112024-11-14T17:05:17.061ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2d28b4f0-7e77-4f31-b664-bd19099a15e8", "date": "Thu, 14 Nov 2024 17:05:16 GMT"} })
52122024-11-14T17:05:17.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52132024-11-14T17:05:17.061ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52142024-11-14T17:05:17.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52152024-11-14T17:05:17.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52162024-11-14T17:05:17.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52172024-11-14T17:05:17.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52182024-11-14T17:05:17.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52192024-11-14T17:05:17.075ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
52202024-11-14T17:05:17.075ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52212024-11-14T17:05:17.075ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bdcf8eb0-21ee-4ba6-9e9f-a5cbd4374ef0", "date": "Thu, 14 Nov 2024 17:05:16 GMT"} })
52222024-11-14T17:05:17.077ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 366.96484ms iteration = 24 status = {}
52232024-11-14T17:05:17.154ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
52242024-11-14T17:05:17.185ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
52252024-11-14T17:05:17.185ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7343f634-11fc-4960-af91-aaa5bc2852b9", "date": "Thu, 14 Nov 2024 17:05:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52262024-11-14T17:05:17.185ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52272024-11-14T17:05:17.187ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6204f120-3850-4448-8d99-22b3927f39c1", "date": "Thu, 14 Nov 2024 17:05:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52282024-11-14T17:05:17.187ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52292024-11-14T17:05:17.188ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52302024-11-14T17:05:17.188ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 478.588278ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
52312024-11-14T17:05:17.228ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
52322024-11-14T17:05:17.229ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfab5257-19d1-4c77-9efc-36c1102c61e7", "content-length": "1", "date": "Thu, 14 Nov 2024 17:05:16 GMT"} })
52332024-11-14T17:05:17.231ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52342024-11-14T17:05:17.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52352024-11-14T17:05:17.234ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 524.137495ms iteration = 23 status = null
52362024-11-14T17:05:17.245ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
52372024-11-14T17:05:17.245ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fab5ec3-a3a4-4ac4-a025-a318d2c4faf4", "content-length": "691", "date": "Thu, 14 Nov 2024 17:05:16 GMT"} })
52382024-11-14T17:05:17.245ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
52392024-11-14T17:05:17.245ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
52402024-11-14T17:05:17.245ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
52412024-11-14T17:05:17.248ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 538.535431ms iteration = 23 status = {}
52422024-11-14T17:05:17.284ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
52432024-11-14T17:05:17.285ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e067638e-f9b4-4ca3-b545-66783ef7f0c4", "date": "Thu, 14 Nov 2024 17:05:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
52442024-11-14T17:05:17.285ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
52452024-11-14T17:05:17.287ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fa733dd5-562b-457c-907f-a0ad142df345", "date": "Thu, 14 Nov 2024 17:05:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
52462024-11-14T17:05:17.287ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
52472024-11-14T17:05:17.289ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "74bfcba9-bfdb-4efb-bb39-7288badfdd81", "date": "Thu, 14 Nov 2024 17:05:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
52482024-11-14T17:05:17.289ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
52492024-11-14T17:05:17.292ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
52502024-11-14T17:05:17.292ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 582.004542ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
52512024-11-14T17:05:17.312ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 602.258698ms iteration = 23 status = {}
52522024-11-14T17:05:17.363ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52532024-11-14T17:05:17.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52542024-11-14T17:05:17.365ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
52552024-11-14T17:05:17.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52562024-11-14T17:05:17.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52572024-11-14T17:05:17.382ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
52582024-11-14T17:05:17.382ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "56874a9b-88b7-4343-bbac-9a140216aafa", "content-length": "134", "date": "Thu, 14 Nov 2024 17:05:16 GMT"} })
52592024-11-14T17:05:17.383ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
52602024-11-14T17:05:17.383ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
52612024-11-14T17:05:17.383ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
52622024-11-14T17:05:17.383ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52632024-11-14T17:05:17.383ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52642024-11-14T17:05:17.383ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52652024-11-14T17:05:17.383ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52662024-11-14T17:05:17.383ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52672024-11-14T17:05:17.383ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52682024-11-14T17:05:17.383ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52692024-11-14T17:05:17.383ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
52702024-11-14T17:05:17.383ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52712024-11-14T17:05:17.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52722024-11-14T17:05:17.386ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
52732024-11-14T17:05:17.386ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "186a5dc5-0952-4305-a9d5-708704e6149d", "content-length": "2", "date": "Thu, 14 Nov 2024 17:05:16 GMT"} })
52742024-11-14T17:05:17.386ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
52752024-11-14T17:05:17.386ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "006c22fd-c8d8-4df0-b98d-a1eaef3639d6", "content-length": "52", "date": "Thu, 14 Nov 2024 17:05:16 GMT"} })
52762024-11-14T17:05:17.386ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
52772024-11-14T17:05:17.386ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52782024-11-14T17:05:17.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 0fd1f4f7-5526-48b3-bf32-a8d8fc951988 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
52792024-11-14T17:05:17.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 0fd1f4f7-5526-48b3-bf32-a8d8fc951988 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
52802024-11-14T17:05:17.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3769 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 0fd1f4f7-5526-48b3-bf32-a8d8fc951988 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
52812024-11-14T17:05:17.506ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a040ea65-05f7-42f5-a380-e8a5402daeba", "date": "Thu, 14 Nov 2024 17:05:16 GMT"} })
52822024-11-14T17:05:17.506ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
52832024-11-14T17:05:17.506ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52842024-11-14T17:05:17.507ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc6300cb-edde-433c-93a5-82d06fb57946", "content-length": "682", "date": "Thu, 14 Nov 2024 17:05:17 GMT"} })
52852024-11-14T17:05:17.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52862024-11-14T17:05:17.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52872024-11-14T17:05:17.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52882024-11-14T17:05:17.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52892024-11-14T17:05:17.515ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52902024-11-14T17:05:17.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52912024-11-14T17:05:17.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52922024-11-14T17:05:17.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52932024-11-14T17:05:17.525ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 815.419796ms iteration = 23 status = {}
52942024-11-14T17:05:17.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0493779e-1db4-40ee-86b2-b59419feedd8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
52952024-11-14T17:05:17.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0493779e-1db4-40ee-86b2-b59419feedd8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
52962024-11-14T17:05:17.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0493779e-1db4-40ee-86b2-b59419feedd8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
52972024-11-14T17:05:18.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 70508880-da91-4cc7-9ae7-5e231277f813 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
52982024-11-14T17:05:18.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 70508880-da91-4cc7-9ae7-5e231277f813 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
52992024-11-14T17:05:18.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 70508880-da91-4cc7-9ae7-5e231277f813 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53002024-11-14T17:05:19.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cc5b818c-fae5-42f8-bc2f-fb37fb6a75f5 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53012024-11-14T17:05:19.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cc5b818c-fae5-42f8-bc2f-fb37fb6a75f5 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53022024-11-14T17:05:19.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cc5b818c-fae5-42f8-bc2f-fb37fb6a75f5 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53032024-11-14T17:05:20.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fb03a3a1-46be-4bbd-9172-80aed8d4e25f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53042024-11-14T17:05:20.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fb03a3a1-46be-4bbd-9172-80aed8d4e25f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53052024-11-14T17:05:20.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fb03a3a1-46be-4bbd-9172-80aed8d4e25f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53062024-11-14T17:05:21.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3ce2998e-d3c8-47ff-91de-e27ec80f97e2 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53072024-11-14T17:05:21.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3ce2998e-d3c8-47ff-91de-e27ec80f97e2 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53082024-11-14T17:05:21.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3ce2998e-d3c8-47ff-91de-e27ec80f97e2 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53092024-11-14T17:05:22.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 00c0fb9b-5011-4107-8d92-d506911c69a8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53102024-11-14T17:05:22.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 00c0fb9b-5011-4107-8d92-d506911c69a8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53112024-11-14T17:05:22.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 00c0fb9b-5011-4107-8d92-d506911c69a8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53122024-11-14T17:05:23.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 83df6eb1-15a0-486e-a069-eff6299d14b8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53132024-11-14T17:05:23.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 83df6eb1-15a0-486e-a069-eff6299d14b8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53142024-11-14T17:05:23.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 83df6eb1-15a0-486e-a069-eff6299d14b8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53152024-11-14T17:05:24.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 61e08a8c-015d-447b-afb9-32ae18cc1094 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53162024-11-14T17:05:24.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 61e08a8c-015d-447b-afb9-32ae18cc1094 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53172024-11-14T17:05:24.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1788 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 61e08a8c-015d-447b-afb9-32ae18cc1094 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53182024-11-14T17:05:25.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b3305d03-e32a-4e54-bd35-ce6d351ec1d7 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53192024-11-14T17:05:25.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b3305d03-e32a-4e54-bd35-ce6d351ec1d7 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53202024-11-14T17:05:25.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b3305d03-e32a-4e54-bd35-ce6d351ec1d7 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53212024-11-14T17:05:26.604ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1538 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = bb0c6724-2e29-4a83-b52d-4a398872aeff response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
53222024-11-14T17:05:26.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
53232024-11-14T17:05:26.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
53242024-11-14T17:05:26.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53252024-11-14T17:05:26.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53262024-11-14T17:05:26.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53272024-11-14T17:05:26.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53282024-11-14T17:05:26.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53292024-11-14T17:05:26.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53302024-11-14T17:05:26.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53312024-11-14T17:05:26.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53322024-11-14T17:05:26.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53332024-11-14T17:05:26.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53342024-11-14T17:05:26.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53352024-11-14T17:05:26.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
53362024-11-14T17:05:26.720ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53372024-11-14T17:05:26.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53382024-11-14T17:05:26.736ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
53392024-11-14T17:05:26.736ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.13673ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
53402024-11-14T17:05:26.747ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53412024-11-14T17:05:26.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53422024-11-14T17:05:26.777ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.135644ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53432024-11-14T17:05:26.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a1dfc428-99de-45bd-a25f-82586602b572 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53442024-11-14T17:05:26.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a1dfc428-99de-45bd-a25f-82586602b572 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53452024-11-14T17:05:26.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a1dfc428-99de-45bd-a25f-82586602b572 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53462024-11-14T17:05:27.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 77503bbd-99b7-42f3-b2f9-02a3b8fec0d1 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53472024-11-14T17:05:27.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 77503bbd-99b7-42f3-b2f9-02a3b8fec0d1 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53482024-11-14T17:05:27.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 77503bbd-99b7-42f3-b2f9-02a3b8fec0d1 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53492024-11-14T17:05:28.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 879a3cb5-3346-4bf2-9c9b-86a1b204bf12 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53502024-11-14T17:05:28.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 879a3cb5-3346-4bf2-9c9b-86a1b204bf12 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53512024-11-14T17:05:28.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 879a3cb5-3346-4bf2-9c9b-86a1b204bf12 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53522024-11-14T17:05:30.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 20b239a5-0a13-4be1-8bd7-7b84c3b8a8b4 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53532024-11-14T17:05:30.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 20b239a5-0a13-4be1-8bd7-7b84c3b8a8b4 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53542024-11-14T17:05:30.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 20b239a5-0a13-4be1-8bd7-7b84c3b8a8b4 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53552024-11-14T17:05:31.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 705f3420-9016-4271-892b-ac007c4c5cb3 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53562024-11-14T17:05:31.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 705f3420-9016-4271-892b-ac007c4c5cb3 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53572024-11-14T17:05:31.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 705f3420-9016-4271-892b-ac007c4c5cb3 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53582024-11-14T17:05:32.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 59c66f02-cd9c-42db-8b57-8934fb56afcd roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53592024-11-14T17:05:32.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 59c66f02-cd9c-42db-8b57-8934fb56afcd resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53602024-11-14T17:05:32.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 59c66f02-cd9c-42db-8b57-8934fb56afcd response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53612024-11-14T17:05:33.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8b5d3f71-5608-483e-b9c7-33c458015b8a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53622024-11-14T17:05:33.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8b5d3f71-5608-483e-b9c7-33c458015b8a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53632024-11-14T17:05:33.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8b5d3f71-5608-483e-b9c7-33c458015b8a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53642024-11-14T17:05:34.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c043e809-a699-4637-bd7c-de48671ad23f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53652024-11-14T17:05:34.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c043e809-a699-4637-bd7c-de48671ad23f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53662024-11-14T17:05:34.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c043e809-a699-4637-bd7c-de48671ad23f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53672024-11-14T17:05:35.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 28de99e7-4058-4a55-a249-6bf38dccd784 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53682024-11-14T17:05:35.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 28de99e7-4058-4a55-a249-6bf38dccd784 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53692024-11-14T17:05:35.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 28de99e7-4058-4a55-a249-6bf38dccd784 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53702024-11-14T17:05:36.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8ee3ff0a-d45b-42f1-bde5-429f71e871b9 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53712024-11-14T17:05:36.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8ee3ff0a-d45b-42f1-bde5-429f71e871b9 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53722024-11-14T17:05:36.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8ee3ff0a-d45b-42f1-bde5-429f71e871b9 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53732024-11-14T17:05:36.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
53742024-11-14T17:05:36.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53752024-11-14T17:05:36.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
53762024-11-14T17:05:36.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53772024-11-14T17:05:36.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53782024-11-14T17:05:36.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53792024-11-14T17:05:36.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53802024-11-14T17:05:36.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53812024-11-14T17:05:36.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53822024-11-14T17:05:36.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53832024-11-14T17:05:36.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53842024-11-14T17:05:36.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53852024-11-14T17:05:36.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53862024-11-14T17:05:36.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
53872024-11-14T17:05:36.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53882024-11-14T17:05:36.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53892024-11-14T17:05:36.731ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
53902024-11-14T17:05:36.731ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.174241ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
53912024-11-14T17:05:36.737ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53922024-11-14T17:05:36.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53932024-11-14T17:05:36.764ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.684816ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53942024-11-14T17:05:37.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 87bde196-a506-454c-889f-52e0720d4791 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53952024-11-14T17:05:37.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 87bde196-a506-454c-889f-52e0720d4791 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53962024-11-14T17:05:37.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 87bde196-a506-454c-889f-52e0720d4791 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53972024-11-14T17:05:38.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9b54e5c4-f608-4de0-bba6-4b4316bf4bb3 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53982024-11-14T17:05:38.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9b54e5c4-f608-4de0-bba6-4b4316bf4bb3 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
53992024-11-14T17:05:38.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9b54e5c4-f608-4de0-bba6-4b4316bf4bb3 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54002024-11-14T17:05:39.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f69ddc73-a4cd-4f25-9d1d-244e2ee4ccea roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54012024-11-14T17:05:39.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f69ddc73-a4cd-4f25-9d1d-244e2ee4ccea resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54022024-11-14T17:05:39.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f69ddc73-a4cd-4f25-9d1d-244e2ee4ccea response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54032024-11-14T17:05:40.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a2b948a1-2a57-4832-9a50-162545b9aba9 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54042024-11-14T17:05:40.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a2b948a1-2a57-4832-9a50-162545b9aba9 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54052024-11-14T17:05:40.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a2b948a1-2a57-4832-9a50-162545b9aba9 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54062024-11-14T17:05:41.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 09e7bf0e-c518-43fa-a2d1-d221a42de1ec roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54072024-11-14T17:05:41.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 09e7bf0e-c518-43fa-a2d1-d221a42de1ec resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54082024-11-14T17:05:41.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 09e7bf0e-c518-43fa-a2d1-d221a42de1ec response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54092024-11-14T17:05:41.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 8240f146-8ee1-4941-b85f-637a5d60c41f response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
54102024-11-14T17:05:42.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e7ebb24e-e056-4c90-9ccc-407339476197 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54112024-11-14T17:05:42.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e7ebb24e-e056-4c90-9ccc-407339476197 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54122024-11-14T17:05:42.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e7ebb24e-e056-4c90-9ccc-407339476197 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54132024-11-14T17:05:43.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a39b14c8-0c0d-41e4-ac98-23472604c446 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54142024-11-14T17:05:43.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a39b14c8-0c0d-41e4-ac98-23472604c446 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54152024-11-14T17:05:43.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a39b14c8-0c0d-41e4-ac98-23472604c446 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54162024-11-14T17:05:44.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c25e00dd-1208-4d29-8f2e-f4a807e4cbb5 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54172024-11-14T17:05:44.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c25e00dd-1208-4d29-8f2e-f4a807e4cbb5 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54182024-11-14T17:05:44.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c25e00dd-1208-4d29-8f2e-f4a807e4cbb5 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54192024-11-14T17:05:45.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2ab7f33d-218e-4624-8ce8-f3d7dee7df95 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54202024-11-14T17:05:45.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2ab7f33d-218e-4624-8ce8-f3d7dee7df95 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54212024-11-14T17:05:45.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2678 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2ab7f33d-218e-4624-8ce8-f3d7dee7df95 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54222024-11-14T17:05:46.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 987dd02f-1082-4d02-abd7-db5491dc7f73 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54232024-11-14T17:05:46.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 987dd02f-1082-4d02-abd7-db5491dc7f73 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54242024-11-14T17:05:46.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 987dd02f-1082-4d02-abd7-db5491dc7f73 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
54252024-11-14T17:05:46.597ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:54959
54262024-11-14T17:05:46.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 655be9c2-0c83-45a9-be1c-46b8776d78f2 roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
54272024-11-14T17:05:46.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 655be9c2-0c83-45a9-be1c-46b8776d78f2 resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
54282024-11-14T17:05:46.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 655be9c2-0c83-45a9-be1c-46b8776d78f2 response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
54292024-11-14T17:05:46.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 3755867d-8c6e-490b-bf26-95bb77d731b4 roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
54302024-11-14T17:05:46.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 3755867d-8c6e-490b-bf26-95bb77d731b4 resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
54312024-11-14T17:05:46.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 3755867d-8c6e-490b-bf26-95bb77d731b4 response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
54322024-11-14T17:05:46.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
54332024-11-14T17:05:46.709ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
54342024-11-14T17:05:46.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54352024-11-14T17:05:46.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54362024-11-14T17:05:46.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
54372024-11-14T17:05:46.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54382024-11-14T17:05:46.709ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
54392024-11-14T17:05:46.709ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54402024-11-14T17:05:46.709ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
54412024-11-14T17:05:46.709ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
54422024-11-14T17:05:46.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54432024-11-14T17:05:46.709ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
54442024-11-14T17:05:46.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
54452024-11-14T17:05:46.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54462024-11-14T17:05:46.709ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
54472024-11-14T17:05:46.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54482024-11-14T17:05:46.709ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54492024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
54502024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54512024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
54522024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
54532024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
54542024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54552024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
54562024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
54572024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
54582024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54592024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54602024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54612024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54622024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54632024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54642024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54652024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54662024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54672024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54682024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54692024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54702024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54712024-11-14T17:05:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
54722024-11-14T17:05:46.711ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
54732024-11-14T17:05:46.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54742024-11-14T17:05:46.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54752024-11-14T17:05:46.711ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
54762024-11-14T17:05:46.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
54772024-11-14T17:05:46.711ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
54782024-11-14T17:05:46.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54792024-11-14T17:05:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54802024-11-14T17:05:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54812024-11-14T17:05:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54822024-11-14T17:05:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54832024-11-14T17:05:46.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54842024-11-14T17:05:46.712ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54852024-11-14T17:05:46.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54862024-11-14T17:05:46.713ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2470, tv_nsec: 442063381 } })
54872024-11-14T17:05:46.713ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
54882024-11-14T17:05:46.713ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54892024-11-14T17:05:46.714ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.403579ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54902024-11-14T17:05:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54912024-11-14T17:05:46.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54922024-11-14T17:05:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54932024-11-14T17:05:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54942024-11-14T17:05:46.716ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54952024-11-14T17:05:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54962024-11-14T17:05:46.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54972024-11-14T17:05:46.721ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2470, tv_nsec: 448060246 } })
54982024-11-14T17:05:46.721ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
54992024-11-14T17:05:46.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55002024-11-14T17:05:46.721ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55012024-11-14T17:05:46.722ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55022024-11-14T17:05:46.722ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
55032024-11-14T17:05:46.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55042024-11-14T17:05:46.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55052024-11-14T17:05:46.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55062024-11-14T17:05:46.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55072024-11-14T17:05:46.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55082024-11-14T17:05:46.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55092024-11-14T17:05:46.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
55102024-11-14T17:05:46.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55112024-11-14T17:05:46.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55122024-11-14T17:05:46.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55132024-11-14T17:05:46.725ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55142024-11-14T17:05:46.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55152024-11-14T17:05:46.726ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55162024-11-14T17:05:46.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55172024-11-14T17:05:46.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55182024-11-14T17:05:46.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.577014ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
55192024-11-14T17:05:46.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55202024-11-14T17:05:46.729ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 19.616853ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55212024-11-14T17:05:46.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55222024-11-14T17:05:46.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55232024-11-14T17:05:46.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55242024-11-14T17:05:46.733ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55252024-11-14T17:05:46.733ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2470, tv_nsec: 462326078 } })
55262024-11-14T17:05:46.733ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
55272024-11-14T17:05:46.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55282024-11-14T17:05:46.756ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55292024-11-14T17:05:46.756ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 46.766665ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55302024-11-14T17:05:46.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55312024-11-14T17:05:46.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55322024-11-14T17:05:46.774ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 64.316661ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55332024-11-14T17:05:46.775ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55342024-11-14T17:05:46.775ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55352024-11-14T17:05:46.775ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55362024-11-14T17:05:46.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55372024-11-14T17:05:46.779ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55382024-11-14T17:05:46.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55392024-11-14T17:05:46.779ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55402024-11-14T17:05:46.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55412024-11-14T17:05:46.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55422024-11-14T17:05:46.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55432024-11-14T17:05:46.781ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55442024-11-14T17:05:46.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55452024-11-14T17:05:46.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55462024-11-14T17:05:46.783ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55472024-11-14T17:05:46.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55482024-11-14T17:05:46.785ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55492024-11-14T17:05:46.785ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55502024-11-14T17:05:46.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55512024-11-14T17:05:46.785ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55522024-11-14T17:05:46.786ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 75.35483ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
55532024-11-14T17:05:46.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
55542024-11-14T17:05:46.788ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55552024-11-14T17:05:46.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55562024-11-14T17:05:46.789ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55572024-11-14T17:05:46.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55582024-11-14T17:05:46.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55592024-11-14T17:05:46.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55602024-11-14T17:05:46.795ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 85.679364ms iteration = 24 status = 0
55612024-11-14T17:05:46.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55622024-11-14T17:05:46.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
55632024-11-14T17:05:46.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55642024-11-14T17:05:46.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55652024-11-14T17:05:46.808ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
55662024-11-14T17:05:46.808ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55672024-11-14T17:05:46.809ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6430b77e-e77d-4fb0-bcfc-1107166b754e", "content-length": "26", "date": "Thu, 14 Nov 2024 17:05:46 GMT"} })
55682024-11-14T17:05:46.809ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55692024-11-14T17:05:46.810ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55702024-11-14T17:05:46.829ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55712024-11-14T17:05:46.829ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55722024-11-14T17:05:46.829ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.19446ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55732024-11-14T17:05:46.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 119.192139ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55742024-11-14T17:05:46.830ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
55752024-11-14T17:05:46.830ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55762024-11-14T17:05:46.830ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "12130e80-d337-484b-896c-b139f1bc6893", "content-length": "26", "date": "Thu, 14 Nov 2024 17:05:46 GMT"} })
55772024-11-14T17:05:46.830ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55782024-11-14T17:05:46.833ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55792024-11-14T17:05:46.837ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 126.286489ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
55802024-11-14T17:05:46.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55812024-11-14T17:05:46.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55822024-11-14T17:05:46.941ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55832024-11-14T17:05:46.942ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf288887-ee43-4291-86bd-bbddb6422d1f", "content-length": "1", "date": "Thu, 14 Nov 2024 17:05:46 GMT"} })
55842024-11-14T17:05:46.943ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55852024-11-14T17:05:46.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55862024-11-14T17:05:46.947ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
55872024-11-14T17:05:46.947ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55882024-11-14T17:05:46.947ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4098b80b-df05-4621-be5a-03610d8c0567", "content-length": "26", "date": "Thu, 14 Nov 2024 17:05:46 GMT"} })
55892024-11-14T17:05:46.947ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55902024-11-14T17:05:46.949ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
55912024-11-14T17:05:46.955ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55922024-11-14T17:05:46.956ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55932024-11-14T17:05:46.956ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "358944db-ec4a-4946-b953-eb1b7c6287f5", "content-length": "372", "date": "Thu, 14 Nov 2024 17:05:46 GMT"} })
55942024-11-14T17:05:46.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55952024-11-14T17:05:46.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55962024-11-14T17:05:46.960ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 250.894921ms iteration = 24 status = null
55972024-11-14T17:05:46.968ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 258.871ms iteration = 24 status = {}
55982024-11-14T17:05:46.971ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
55992024-11-14T17:05:46.971ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 261.662504ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
56002024-11-14T17:05:47.019ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
56012024-11-14T17:05:47.019ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
56022024-11-14T17:05:47.020ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "55a2deb1-d3ef-4e86-b867-9806b15faa43", "date": "Thu, 14 Nov 2024 17:05:46 GMT"} })
56032024-11-14T17:05:47.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56042024-11-14T17:05:47.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56052024-11-14T17:05:47.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56062024-11-14T17:05:47.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56072024-11-14T17:05:47.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56082024-11-14T17:05:47.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56092024-11-14T17:05:47.030ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56102024-11-14T17:05:47.030ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56112024-11-14T17:05:47.031ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3e058419-03f0-47bf-952b-b20199000d04", "date": "Thu, 14 Nov 2024 17:05:46 GMT"} })
56122024-11-14T17:05:47.033ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 323.740504ms iteration = 25 status = {}
56132024-11-14T17:05:47.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56142024-11-14T17:05:47.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56152024-11-14T17:05:47.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56162024-11-14T17:05:47.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56172024-11-14T17:05:47.070ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
56182024-11-14T17:05:47.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56192024-11-14T17:05:47.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56202024-11-14T17:05:47.072ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 362.914178ms iteration = 28 status = {"physical_disks_added":0}
56212024-11-14T17:05:47.088ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56222024-11-14T17:05:47.088ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "67f499d6-33d5-4e5d-a8ac-3db71b3f424e", "content-length": "134", "date": "Thu, 14 Nov 2024 17:05:47 GMT"} })
56232024-11-14T17:05:47.088ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56242024-11-14T17:05:47.088ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
56252024-11-14T17:05:47.089ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56262024-11-14T17:05:47.089ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56272024-11-14T17:05:47.089ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56282024-11-14T17:05:47.089ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56292024-11-14T17:05:47.089ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56302024-11-14T17:05:47.089ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56312024-11-14T17:05:47.089ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56322024-11-14T17:05:47.089ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56332024-11-14T17:05:47.089ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
56342024-11-14T17:05:47.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56352024-11-14T17:05:47.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56362024-11-14T17:05:47.092ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56372024-11-14T17:05:47.092ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "60e35646-03f0-4f4a-9190-c05b9c99a12f", "content-length": "2", "date": "Thu, 14 Nov 2024 17:05:47 GMT"} })
56382024-11-14T17:05:47.092ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56392024-11-14T17:05:47.092ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "04865215-fac9-46cb-ad72-eaebef3bfae3", "content-length": "52", "date": "Thu, 14 Nov 2024 17:05:47 GMT"} })
56402024-11-14T17:05:47.092ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
56412024-11-14T17:05:47.092ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56422024-11-14T17:05:47.112ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56432024-11-14T17:05:47.114ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56442024-11-14T17:05:47.114ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56452024-11-14T17:05:47.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56462024-11-14T17:05:47.142ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56472024-11-14T17:05:47.144ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56482024-11-14T17:05:47.144ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56492024-11-14T17:05:47.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56502024-11-14T17:05:47.200ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "84321bd2-d81b-41cb-96a3-46905df305f5", "date": "Thu, 14 Nov 2024 17:05:46 GMT"} })
56512024-11-14T17:05:47.200ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
56522024-11-14T17:05:47.200ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56532024-11-14T17:05:47.201ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd14bb2c-716a-43e2-9d7d-6b3258813974", "content-length": "682", "date": "Thu, 14 Nov 2024 17:05:47 GMT"} })
56542024-11-14T17:05:47.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56552024-11-14T17:05:47.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56562024-11-14T17:05:47.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56572024-11-14T17:05:47.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56582024-11-14T17:05:47.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56592024-11-14T17:05:47.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56602024-11-14T17:05:47.211ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56612024-11-14T17:05:47.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56622024-11-14T17:05:47.235ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56632024-11-14T17:05:47.242ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 532.404142ms iteration = 24 status = {}
56642024-11-14T17:05:47.242ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1446a4ac-7358-4859-baf4-8e9276511861", "content-length": "691", "date": "Thu, 14 Nov 2024 17:05:47 GMT"} })
56652024-11-14T17:05:47.242ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
56662024-11-14T17:05:47.242ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
56672024-11-14T17:05:47.242ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
56682024-11-14T17:05:47.243ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 533.837475ms iteration = 24 status = {}
56692024-11-14T17:05:47.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 91780bcb-5f2e-462d-a873-55b319bf02a5 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56702024-11-14T17:05:47.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 91780bcb-5f2e-462d-a873-55b319bf02a5 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56712024-11-14T17:05:47.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 91780bcb-5f2e-462d-a873-55b319bf02a5 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56722024-11-14T17:05:47.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 108191c9-fbde-4fe2-945b-950c37994318 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
56732024-11-14T17:05:47.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 108191c9-fbde-4fe2-945b-950c37994318 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
56742024-11-14T17:05:47.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 108191c9-fbde-4fe2-945b-950c37994318 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
56752024-11-14T17:05:48.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1bc2bffd-7e7f-433e-858a-a17357654dbb roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56762024-11-14T17:05:48.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1bc2bffd-7e7f-433e-858a-a17357654dbb resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56772024-11-14T17:05:48.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1bc2bffd-7e7f-433e-858a-a17357654dbb response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56782024-11-14T17:05:49.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 37d46c08-9962-4a8f-8222-6aeb0a2ffd33 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56792024-11-14T17:05:49.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 37d46c08-9962-4a8f-8222-6aeb0a2ffd33 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56802024-11-14T17:05:49.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 37d46c08-9962-4a8f-8222-6aeb0a2ffd33 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56812024-11-14T17:05:50.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 76793075-df68-40da-8499-fc3572db78c8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56822024-11-14T17:05:50.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 76793075-df68-40da-8499-fc3572db78c8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56832024-11-14T17:05:50.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 76793075-df68-40da-8499-fc3572db78c8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56842024-11-14T17:05:51.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4c41ce46-4c1b-4e27-9a68-b7d81cf6ce3a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56852024-11-14T17:05:51.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4c41ce46-4c1b-4e27-9a68-b7d81cf6ce3a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56862024-11-14T17:05:51.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2581 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4c41ce46-4c1b-4e27-9a68-b7d81cf6ce3a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56872024-11-14T17:05:52.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e0cf5ae1-8cf9-4fd3-8ea0-e12d65097e88 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56882024-11-14T17:05:52.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e0cf5ae1-8cf9-4fd3-8ea0-e12d65097e88 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56892024-11-14T17:05:52.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e0cf5ae1-8cf9-4fd3-8ea0-e12d65097e88 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56902024-11-14T17:05:53.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0b2792c9-ab10-4978-95ea-cebb30841ef8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56912024-11-14T17:05:53.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0b2792c9-ab10-4978-95ea-cebb30841ef8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56922024-11-14T17:05:53.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0b2792c9-ab10-4978-95ea-cebb30841ef8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56932024-11-14T17:05:54.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 473c113e-b032-4eac-aa64-7d06881ee799 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56942024-11-14T17:05:54.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 473c113e-b032-4eac-aa64-7d06881ee799 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56952024-11-14T17:05:54.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 473c113e-b032-4eac-aa64-7d06881ee799 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56962024-11-14T17:05:55.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0fbb0d97-ea7f-42fc-9809-6696f875c4b0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56972024-11-14T17:05:55.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0fbb0d97-ea7f-42fc-9809-6696f875c4b0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56982024-11-14T17:05:55.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0fbb0d97-ea7f-42fc-9809-6696f875c4b0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
56992024-11-14T17:05:56.607ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1298 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = da4ab8ba-2541-43ba-87f6-6030ed5cd87f response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
57002024-11-14T17:05:56.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6a3cf9e8-b7ea-4939-87c0-5ad7885481fa roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57012024-11-14T17:05:56.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6a3cf9e8-b7ea-4939-87c0-5ad7885481fa resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57022024-11-14T17:05:56.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6a3cf9e8-b7ea-4939-87c0-5ad7885481fa response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57032024-11-14T17:05:56.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
57042024-11-14T17:05:56.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
57052024-11-14T17:05:56.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57062024-11-14T17:05:56.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57072024-11-14T17:05:56.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57082024-11-14T17:05:56.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57092024-11-14T17:05:56.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57102024-11-14T17:05:56.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57112024-11-14T17:05:56.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57122024-11-14T17:05:56.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57132024-11-14T17:05:56.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57142024-11-14T17:05:56.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57152024-11-14T17:05:56.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57162024-11-14T17:05:56.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57172024-11-14T17:05:56.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57182024-11-14T17:05:56.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
57192024-11-14T17:05:56.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57202024-11-14T17:05:56.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57212024-11-14T17:05:56.760ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
57222024-11-14T17:05:56.760ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.349839ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
57232024-11-14T17:05:56.769ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.505142ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57242024-11-14T17:05:57.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fc85bf4b-bd79-4409-ae3c-ac2e5bab44d2 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57252024-11-14T17:05:57.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fc85bf4b-bd79-4409-ae3c-ac2e5bab44d2 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57262024-11-14T17:05:57.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fc85bf4b-bd79-4409-ae3c-ac2e5bab44d2 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57272024-11-14T17:05:58.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d9e90212-721f-4179-88e3-f42542feab1f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57282024-11-14T17:05:58.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d9e90212-721f-4179-88e3-f42542feab1f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57292024-11-14T17:05:58.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d9e90212-721f-4179-88e3-f42542feab1f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57302024-11-14T17:05:59.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 26a97b1c-340b-42cb-aac7-8e434306327a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57312024-11-14T17:05:59.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 26a97b1c-340b-42cb-aac7-8e434306327a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57322024-11-14T17:05:59.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 26a97b1c-340b-42cb-aac7-8e434306327a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57332024-11-14T17:06:00.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a48bba28-4d34-4115-8638-93e8a3af939b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57342024-11-14T17:06:00.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a48bba28-4d34-4115-8638-93e8a3af939b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57352024-11-14T17:06:00.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2697 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a48bba28-4d34-4115-8638-93e8a3af939b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57362024-11-14T17:06:01.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9fa2a1a3-cd9c-498c-8cf4-537250859c87 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57372024-11-14T17:06:01.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9fa2a1a3-cd9c-498c-8cf4-537250859c87 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57382024-11-14T17:06:01.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9fa2a1a3-cd9c-498c-8cf4-537250859c87 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57392024-11-14T17:06:02.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 07b788dc-495f-4d4e-a45e-449fa128d6a8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57402024-11-14T17:06:02.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 07b788dc-495f-4d4e-a45e-449fa128d6a8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57412024-11-14T17:06:02.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 07b788dc-495f-4d4e-a45e-449fa128d6a8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57422024-11-14T17:06:03.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e11a9152-1f9f-4c75-b88a-de05bd9eda85 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57432024-11-14T17:06:03.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e11a9152-1f9f-4c75-b88a-de05bd9eda85 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57442024-11-14T17:06:03.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e11a9152-1f9f-4c75-b88a-de05bd9eda85 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57452024-11-14T17:06:04.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b914340f-fe1f-4aae-9812-55147c7cfcfa roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57462024-11-14T17:06:04.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b914340f-fe1f-4aae-9812-55147c7cfcfa resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57472024-11-14T17:06:04.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b914340f-fe1f-4aae-9812-55147c7cfcfa response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57482024-11-14T17:06:05.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 069a2d36-b456-48f5-beba-f58cead477cf roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57492024-11-14T17:06:05.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 069a2d36-b456-48f5-beba-f58cead477cf resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57502024-11-14T17:06:05.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 069a2d36-b456-48f5-beba-f58cead477cf response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57512024-11-14T17:06:06.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
57522024-11-14T17:06:06.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
57532024-11-14T17:06:06.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57542024-11-14T17:06:06.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57552024-11-14T17:06:06.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57562024-11-14T17:06:06.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57572024-11-14T17:06:06.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57582024-11-14T17:06:06.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57592024-11-14T17:06:06.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57602024-11-14T17:06:06.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57612024-11-14T17:06:06.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57622024-11-14T17:06:06.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57632024-11-14T17:06:06.741ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57642024-11-14T17:06:06.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57652024-11-14T17:06:06.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57662024-11-14T17:06:06.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
57672024-11-14T17:06:06.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57682024-11-14T17:06:06.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57692024-11-14T17:06:06.757ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
57702024-11-14T17:06:06.757ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.88402ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
57712024-11-14T17:06:06.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.942838ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57722024-11-14T17:06:06.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 17b7d7b3-ca97-4534-932f-4d2b70e1df2f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57732024-11-14T17:06:06.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 17b7d7b3-ca97-4534-932f-4d2b70e1df2f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57742024-11-14T17:06:06.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 17b7d7b3-ca97-4534-932f-4d2b70e1df2f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57752024-11-14T17:06:07.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = acef25fd-5605-4f77-98c5-b6915fe246d6 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57762024-11-14T17:06:07.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = acef25fd-5605-4f77-98c5-b6915fe246d6 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57772024-11-14T17:06:07.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = acef25fd-5605-4f77-98c5-b6915fe246d6 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57782024-11-14T17:06:08.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 59540bfc-cc8c-4e6a-92c4-a3a2f5e52f4d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57792024-11-14T17:06:08.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 59540bfc-cc8c-4e6a-92c4-a3a2f5e52f4d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57802024-11-14T17:06:08.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 59540bfc-cc8c-4e6a-92c4-a3a2f5e52f4d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57812024-11-14T17:06:09.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d73a4df1-d018-42a3-bad5-c302884ee276 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57822024-11-14T17:06:09.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d73a4df1-d018-42a3-bad5-c302884ee276 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57832024-11-14T17:06:09.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d73a4df1-d018-42a3-bad5-c302884ee276 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57842024-11-14T17:06:10.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 493ac113-f08a-4fe3-89c5-e9c46aff79f1 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57852024-11-14T17:06:10.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 493ac113-f08a-4fe3-89c5-e9c46aff79f1 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57862024-11-14T17:06:10.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 493ac113-f08a-4fe3-89c5-e9c46aff79f1 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57872024-11-14T17:06:11.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1742 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 2fddccd7-f63d-464e-be61-a0ef6e2553a1 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
57882024-11-14T17:06:11.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0a4b8c1d-0809-4d31-af52-ee7218e0bae5 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57892024-11-14T17:06:12.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0a4b8c1d-0809-4d31-af52-ee7218e0bae5 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57902024-11-14T17:06:12.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0a4b8c1d-0809-4d31-af52-ee7218e0bae5 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57912024-11-14T17:06:13.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f45567b0-004d-4eeb-9ccd-e288883f4a94 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57922024-11-14T17:06:13.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f45567b0-004d-4eeb-9ccd-e288883f4a94 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57932024-11-14T17:06:13.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f45567b0-004d-4eeb-9ccd-e288883f4a94 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57942024-11-14T17:06:14.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fb660d0e-9cf8-49a8-bd18-56daf2a50234 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57952024-11-14T17:06:14.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fb660d0e-9cf8-49a8-bd18-56daf2a50234 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57962024-11-14T17:06:14.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fb660d0e-9cf8-49a8-bd18-56daf2a50234 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57972024-11-14T17:06:15.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9891b1f3-00fd-4421-9c28-d559844b181b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57982024-11-14T17:06:15.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9891b1f3-00fd-4421-9c28-d559844b181b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
57992024-11-14T17:06:15.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9891b1f3-00fd-4421-9c28-d559844b181b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
58002024-11-14T17:06:16.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 54e1aac8-3c95-49b6-a0ec-6be19ee5dd86 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
58012024-11-14T17:06:16.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 54e1aac8-3c95-49b6-a0ec-6be19ee5dd86 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
58022024-11-14T17:06:16.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 54e1aac8-3c95-49b6-a0ec-6be19ee5dd86 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
58032024-11-14T17:06:16.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 90b2e28d-63f9-4050-b4d0-f4dec3de7c0c roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
58042024-11-14T17:06:16.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 90b2e28d-63f9-4050-b4d0-f4dec3de7c0c resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
58052024-11-14T17:06:16.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 90b2e28d-63f9-4050-b4d0-f4dec3de7c0c response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
58062024-11-14T17:06:16.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 16f1cbc3-6767-475a-b024-57fdd2ca6730 roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
58072024-11-14T17:06:16.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 16f1cbc3-6767-475a-b024-57fdd2ca6730 resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
58082024-11-14T17:06:16.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 16f1cbc3-6767-475a-b024-57fdd2ca6730 response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
58092024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
58102024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58112024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
58122024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
58132024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58142024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
58152024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
58162024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
58172024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58182024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58192024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
58202024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
58212024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58222024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58232024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
58242024-11-14T17:06:16.709ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58252024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
58262024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58272024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
58282024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
58292024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58302024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58312024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
58322024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58332024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
58342024-11-14T17:06:16.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58352024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
58362024-11-14T17:06:16.710ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 16:56:16.709942200 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
58372024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
58382024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
58392024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58402024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
58412024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
58422024-11-14T17:06:16.710ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
58432024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
58442024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
58452024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58462024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
58472024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
58482024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58492024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
58502024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58512024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
58522024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
58532024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
58542024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
58552024-11-14T17:06:16.710ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5
58562024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58572024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.06\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5"}
58582024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
58592024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58602024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
58612024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58622024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58632024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58642024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58652024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58662024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58672024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58682024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58692024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
58702024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58712024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58722024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58732024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
58742024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58752024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58762024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58772024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58782024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58792024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
58802024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
58812024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58822024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58832024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58842024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
58852024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
58862024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58872024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58882024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
58892024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
58902024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
58912024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
58922024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58932024-11-14T17:06:16.710ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94482e71-9503-4d09-b73f-615fbf343a2e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2500, tv_nsec: 439548173 } })
58942024-11-14T17:06:16.710ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89b01be2-c37f-445d-addd-6b4be9cd73c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc5fdca1-6d92-4ff4-b5ae-2f44553a2186.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2500, tv_nsec: 439548363 } })
58952024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58962024-11-14T17:06:16.710ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58972024-11-14T17:06:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58982024-11-14T17:06:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58992024-11-14T17:06:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59002024-11-14T17:06:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
59012024-11-14T17:06:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59022024-11-14T17:06:16.711ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59032024-11-14T17:06:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
59042024-11-14T17:06:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
59052024-11-14T17:06:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59062024-11-14T17:06:16.711ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59072024-11-14T17:06:16.711ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
59082024-11-14T17:06:16.711ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.369701ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
59092024-11-14T17:06:16.711ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
59102024-11-14T17:06:16.711ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.427472ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
59112024-11-14T17:06:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59122024-11-14T17:06:16.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59132024-11-14T17:06:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59142024-11-14T17:06:16.712ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59152024-11-14T17:06:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59162024-11-14T17:06:16.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59172024-11-14T17:06:16.714ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59182024-11-14T17:06:16.714ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.290596ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
59192024-11-14T17:06:16.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
59202024-11-14T17:06:16.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59212024-11-14T17:06:16.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59222024-11-14T17:06:16.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
59232024-11-14T17:06:16.716ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59242024-11-14T17:06:16.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59252024-11-14T17:06:16.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59262024-11-14T17:06:16.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59272024-11-14T17:06:16.718ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 16:56:16.709942200 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
59282024-11-14T17:06:16.718ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.002543ms iteration = 13 status = {"expiration":"2024-11-14T16:56:16.709942200Z","pruned":[]}
59292024-11-14T17:06:16.719ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59302024-11-14T17:06:16.720ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59312024-11-14T17:06:16.722ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2500, tv_nsec: 451000371 } })
59322024-11-14T17:06:16.722ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
59332024-11-14T17:06:16.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59342024-11-14T17:06:16.723ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59352024-11-14T17:06:16.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59362024-11-14T17:06:16.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
59372024-11-14T17:06:16.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59382024-11-14T17:06:16.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59392024-11-14T17:06:16.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59402024-11-14T17:06:16.729ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2500, tv_nsec: 457742943 } })
59412024-11-14T17:06:16.729ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
59422024-11-14T17:06:16.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59432024-11-14T17:06:16.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59442024-11-14T17:06:16.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59452024-11-14T17:06:16.734ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59462024-11-14T17:06:16.734ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 24.128094ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
59472024-11-14T17:06:16.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59482024-11-14T17:06:16.737ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59492024-11-14T17:06:16.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59502024-11-14T17:06:16.781ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59512024-11-14T17:06:16.781ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59522024-11-14T17:06:16.781ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59532024-11-14T17:06:16.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59542024-11-14T17:06:16.784ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59552024-11-14T17:06:16.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59562024-11-14T17:06:16.786ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2500, tv_nsec: 514986145 } })
59572024-11-14T17:06:16.786ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
59582024-11-14T17:06:16.787ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59592024-11-14T17:06:16.788ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59602024-11-14T17:06:16.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59612024-11-14T17:06:16.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59622024-11-14T17:06:16.791ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
59632024-11-14T17:06:16.792ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59642024-11-14T17:06:16.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59652024-11-14T17:06:16.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
59662024-11-14T17:06:16.793ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
59672024-11-14T17:06:16.793ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59682024-11-14T17:06:16.793ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59692024-11-14T17:06:16.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
59702024-11-14T17:06:16.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59712024-11-14T17:06:16.793ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59722024-11-14T17:06:16.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59732024-11-14T17:06:16.794ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59742024-11-14T17:06:16.796ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59752024-11-14T17:06:16.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59762024-11-14T17:06:16.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59772024-11-14T17:06:16.798ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59782024-11-14T17:06:16.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59792024-11-14T17:06:16.798ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59802024-11-14T17:06:16.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59812024-11-14T17:06:16.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59822024-11-14T17:06:16.800ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
59832024-11-14T17:06:16.800ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
59842024-11-14T17:06:16.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59852024-11-14T17:06:16.800ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 90.132533ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
59862024-11-14T17:06:16.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59872024-11-14T17:06:16.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59882024-11-14T17:06:16.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59892024-11-14T17:06:16.803ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59902024-11-14T17:06:16.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 92.431796ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
59912024-11-14T17:06:16.804ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59922024-11-14T17:06:16.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59932024-11-14T17:06:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59942024-11-14T17:06:16.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59952024-11-14T17:06:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59962024-11-14T17:06:16.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 95.844763ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
59972024-11-14T17:06:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59982024-11-14T17:06:16.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
59992024-11-14T17:06:16.810ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60002024-11-14T17:06:16.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60012024-11-14T17:06:16.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 102.645486ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
60022024-11-14T17:06:16.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60032024-11-14T17:06:16.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60042024-11-14T17:06:16.815ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60052024-11-14T17:06:16.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60062024-11-14T17:06:16.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60072024-11-14T17:06:16.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60082024-11-14T17:06:16.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60092024-11-14T17:06:16.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60102024-11-14T17:06:16.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60112024-11-14T17:06:16.820ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
60122024-11-14T17:06:16.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60132024-11-14T17:06:16.826ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60142024-11-14T17:06:16.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60152024-11-14T17:06:16.830ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60162024-11-14T17:06:16.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60172024-11-14T17:06:16.837ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 127.251821ms iteration = 6 status = {"nsuccess":5}
60182024-11-14T17:06:16.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 128.55771ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60192024-11-14T17:06:16.857ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
60202024-11-14T17:06:16.858ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
60212024-11-14T17:06:16.858ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
60222024-11-14T17:06:16.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60232024-11-14T17:06:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60242024-11-14T17:06:16.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60252024-11-14T17:06:16.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
60262024-11-14T17:06:16.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60272024-11-14T17:06:16.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
60282024-11-14T17:06:16.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60292024-11-14T17:06:16.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60302024-11-14T17:06:16.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60312024-11-14T17:06:16.868ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
60322024-11-14T17:06:16.868ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 158.401834ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
60332024-11-14T17:06:16.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 158.68006ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60342024-11-14T17:06:16.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60352024-11-14T17:06:16.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60362024-11-14T17:06:16.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60372024-11-14T17:06:16.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60382024-11-14T17:06:16.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60392024-11-14T17:06:16.872ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
60402024-11-14T17:06:16.874ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60412024-11-14T17:06:16.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60422024-11-14T17:06:16.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60432024-11-14T17:06:16.877ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60442024-11-14T17:06:16.877ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
60452024-11-14T17:06:16.878ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
60462024-11-14T17:06:16.878ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 168.107503ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
60472024-11-14T17:06:16.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60482024-11-14T17:06:16.879ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60492024-11-14T17:06:16.879ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
60502024-11-14T17:06:16.879ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60512024-11-14T17:06:16.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60522024-11-14T17:06:16.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
60532024-11-14T17:06:16.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60542024-11-14T17:06:16.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60552024-11-14T17:06:16.886ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60562024-11-14T17:06:16.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60572024-11-14T17:06:16.895ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
60582024-11-14T17:06:16.895ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
60592024-11-14T17:06:16.896ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
60602024-11-14T17:06:16.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60612024-11-14T17:06:16.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60622024-11-14T17:06:16.923ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60632024-11-14T17:06:16.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60642024-11-14T17:06:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60652024-11-14T17:06:16.926ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
60662024-11-14T17:06:16.926ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
60672024-11-14T17:06:16.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60682024-11-14T17:06:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60692024-11-14T17:06:16.926ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60702024-11-14T17:06:16.926ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60712024-11-14T17:06:16.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60722024-11-14T17:06:16.928ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
60732024-11-14T17:06:16.928ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60742024-11-14T17:06:16.929ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf0eff3f-6177-4d05-a830-5ce3d6b9f7be", "content-length": "26", "date": "Thu, 14 Nov 2024 17:06:16 GMT"} })
60752024-11-14T17:06:16.929ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60762024-11-14T17:06:16.932ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60772024-11-14T17:06:16.937ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60782024-11-14T17:06:16.937ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
60792024-11-14T17:06:16.937ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 227.555934ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
60802024-11-14T17:06:16.938ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60812024-11-14T17:06:16.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
60822024-11-14T17:06:16.943ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60832024-11-14T17:06:16.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60842024-11-14T17:06:16.983ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 273.192144ms iteration = 29 status = {"physical_disks_added":0}
60852024-11-14T17:06:17.005ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
60862024-11-14T17:06:17.006ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
60872024-11-14T17:06:17.006ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60882024-11-14T17:06:17.006ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "59721310-ca69-4673-a270-27ed4131380f", "content-length": "26", "date": "Thu, 14 Nov 2024 17:06:16 GMT"} })
60892024-11-14T17:06:17.006ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60902024-11-14T17:06:17.008ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
60912024-11-14T17:06:17.028ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
60922024-11-14T17:06:17.028ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 318.172668ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
60932024-11-14T17:06:17.047ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
60942024-11-14T17:06:17.047ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60952024-11-14T17:06:17.047ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "22530946-befb-4bb9-aee5-c40ced131212", "content-length": "372", "date": "Thu, 14 Nov 2024 17:06:17 GMT"} })
60962024-11-14T17:06:17.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60972024-11-14T17:06:17.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60982024-11-14T17:06:17.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60992024-11-14T17:06:17.051ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61002024-11-14T17:06:17.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61012024-11-14T17:06:17.054ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61022024-11-14T17:06:17.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61032024-11-14T17:06:17.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61042024-11-14T17:06:17.056ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61052024-11-14T17:06:17.056ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 346.382205ms iteration = 25 status = 0
61062024-11-14T17:06:17.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61072024-11-14T17:06:17.059ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
61082024-11-14T17:06:17.059ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
61092024-11-14T17:06:17.059ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 16:54:46.198050 UTC dns_group = internal generation = 1
61102024-11-14T17:06:17.059ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 349.512075ms iteration = 14 status = {"generation":1}
61112024-11-14T17:06:17.060ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
61122024-11-14T17:06:17.060ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61132024-11-14T17:06:17.060ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f633132b-5960-4382-b112-f1c69c15c1a6", "content-length": "26", "date": "Thu, 14 Nov 2024 17:06:16 GMT"} })
61142024-11-14T17:06:17.060ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61152024-11-14T17:06:17.062ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
61162024-11-14T17:06:17.062ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 352.543644ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
61172024-11-14T17:06:17.062ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61182024-11-14T17:06:17.077ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 367.215005ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
61192024-11-14T17:06:17.094ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
61202024-11-14T17:06:17.094ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 0 version = 2
61212024-11-14T17:06:17.094ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61222024-11-14T17:06:17.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61232024-11-14T17:06:17.095ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61242024-11-14T17:06:17.095ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T16:54:14.392760Z, time_modified: 2024-11-14T16:54:14.392760Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
61252024-11-14T17:06:17.095ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 385.875127ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]}},"default_endpoint":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
61262024-11-14T17:06:17.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61272024-11-14T17:06:17.098ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61282024-11-14T17:06:17.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61292024-11-14T17:06:17.100ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 1 version = 2
61302024-11-14T17:06:17.100ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
61312024-11-14T17:06:17.100ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 16:54:47.468912 UTC dns_group = external generation = 2
61322024-11-14T17:06:17.100ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 390.723886ms iteration = 14 status = {"generation":2}
61332024-11-14T17:06:17.112ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {f5a3cbc2-404e-43a0-8459-9f0ac080dd26: {10.151.1.175: {812e4d69-c3da-49d6-b5fe-cfa5df819e14}, 10.151.1.176: {812e4d69-c3da-49d6-b5fe-cfa5df819e14}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
61342024-11-14T17:06:17.112ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
61352024-11-14T17:06:17.115ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0d369d79-6ef3-4e24-9275-a64ccd2c71ab", "date": "Thu, 14 Nov 2024 17:06:17 GMT"} })
61362024-11-14T17:06:17.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61372024-11-14T17:06:17.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61382024-11-14T17:06:17.117ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61392024-11-14T17:06:17.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61402024-11-14T17:06:17.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61412024-11-14T17:06:17.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61422024-11-14T17:06:17.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 06882538-921f-40a2-98e2-18294ccc60e7 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
61432024-11-14T17:06:17.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 06882538-921f-40a2-98e2-18294ccc60e7 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
61442024-11-14T17:06:17.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 06882538-921f-40a2-98e2-18294ccc60e7 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
61452024-11-14T17:06:17.130ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
61462024-11-14T17:06:17.130ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61472024-11-14T17:06:17.140ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
61482024-11-14T17:06:17.140ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "66c539f7-4324-4379-af79-806dd4685434", "date": "Thu, 14 Nov 2024 17:06:17 GMT"} })
61492024-11-14T17:06:17.141ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 432.081899ms iteration = 26 status = {}
61502024-11-14T17:06:17.142ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0198c8f2-74fe-4429-8ace-777dcfdc317d", "date": "Thu, 14 Nov 2024 17:06:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61512024-11-14T17:06:17.142ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61522024-11-14T17:06:17.144ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a8fe94a7-d47c-403a-9b00-caa89184fc9d", "date": "Thu, 14 Nov 2024 17:06:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61532024-11-14T17:06:17.144ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61542024-11-14T17:06:17.146ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61552024-11-14T17:06:17.146ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 436.267393ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
61562024-11-14T17:06:17.158ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61572024-11-14T17:06:17.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61582024-11-14T17:06:17.160ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61592024-11-14T17:06:17.162ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61602024-11-14T17:06:17.162ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61612024-11-14T17:06:17.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61622024-11-14T17:06:17.164ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
61632024-11-14T17:06:17.164ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "59b90341-0834-4727-99f7-020ad5ed4799", "content-length": "1", "date": "Thu, 14 Nov 2024 17:06:16 GMT"} })
61642024-11-14T17:06:17.166ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61652024-11-14T17:06:17.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61662024-11-14T17:06:17.168ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 458.344811ms iteration = 25 status = null
61672024-11-14T17:06:17.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61682024-11-14T17:06:17.201ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61692024-11-14T17:06:17.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61702024-11-14T17:06:17.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61712024-11-14T17:06:17.245ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
61722024-11-14T17:06:17.245ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6625b257-ddae-4e85-ae87-2fa8867d4bcb", "date": "Thu, 14 Nov 2024 17:06:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61732024-11-14T17:06:17.246ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61742024-11-14T17:06:17.248ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "dde91e22-a2bd-40bc-9435-b9f4dc4fb76a", "date": "Thu, 14 Nov 2024 17:06:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61752024-11-14T17:06:17.248ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61762024-11-14T17:06:17.250ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "02a6491a-fc1a-4704-adea-d824cb2d9eb9", "date": "Thu, 14 Nov 2024 17:06:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61772024-11-14T17:06:17.251ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61782024-11-14T17:06:17.254ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61792024-11-14T17:06:17.254ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 544.434424ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
61802024-11-14T17:06:17.276ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 566.110113ms iteration = 25 status = {}
61812024-11-14T17:06:17.335ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
61822024-11-14T17:06:17.336ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "abac96c5-7c79-4a12-9a0c-4f3119dbba88", "content-length": "810", "date": "Thu, 14 Nov 2024 17:06:17 GMT"} })
61832024-11-14T17:06:17.336ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(5658212) }} sled = buskin
61842024-11-14T17:06:17.336ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
61852024-11-14T17:06:17.336ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
61862024-11-14T17:06:17.338ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 628.155432ms iteration = 25 status = {}
61872024-11-14T17:06:17.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61882024-11-14T17:06:17.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61892024-11-14T17:06:17.343ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
61902024-11-14T17:06:17.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61912024-11-14T17:06:17.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61922024-11-14T17:06:17.354ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
61932024-11-14T17:06:17.354ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "86e21108-c16c-46e2-baeb-b6120c895a10", "content-length": "134", "date": "Thu, 14 Nov 2024 17:06:17 GMT"} })
61942024-11-14T17:06:17.354ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
61952024-11-14T17:06:17.354ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
61962024-11-14T17:06:17.354ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
61972024-11-14T17:06:17.354ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
61982024-11-14T17:06:17.354ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61992024-11-14T17:06:17.354ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62002024-11-14T17:06:17.354ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62012024-11-14T17:06:17.354ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62022024-11-14T17:06:17.355ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62032024-11-14T17:06:17.355ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62042024-11-14T17:06:17.355ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
62052024-11-14T17:06:17.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62062024-11-14T17:06:17.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62072024-11-14T17:06:17.357ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
62082024-11-14T17:06:17.357ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d45b5c0-b095-4308-adc5-310a3e188ad6", "content-length": "2", "date": "Thu, 14 Nov 2024 17:06:17 GMT"} })
62092024-11-14T17:06:17.357ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
62102024-11-14T17:06:17.357ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a715350-2f03-4732-8c91-ee770588f728", "content-length": "52", "date": "Thu, 14 Nov 2024 17:06:17 GMT"} })
62112024-11-14T17:06:17.357ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
62122024-11-14T17:06:17.357ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
62132024-11-14T17:06:17.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 64e91a84-2e8d-4360-a58d-4adeb5dae445 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
62142024-11-14T17:06:17.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 64e91a84-2e8d-4360-a58d-4adeb5dae445 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
62152024-11-14T17:06:17.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 64e91a84-2e8d-4360-a58d-4adeb5dae445 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
62162024-11-14T17:06:17.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = b15c8c96-171b-4edd-a160-b1100be87584 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
62172024-11-14T17:06:17.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = b15c8c96-171b-4edd-a160-b1100be87584 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
62182024-11-14T17:06:17.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = b15c8c96-171b-4edd-a160-b1100be87584 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
62192024-11-14T17:06:17.700ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0fa106de-b9c3-4f09-bf3c-876f4c8d0f61", "date": "Thu, 14 Nov 2024 17:06:17 GMT"} })
62202024-11-14T17:06:17.700ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
62212024-11-14T17:06:17.700ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
62222024-11-14T17:06:17.701ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "876d26a5-d049-4978-9ff8-024df0df2a83", "content-length": "682", "date": "Thu, 14 Nov 2024 17:06:17 GMT"} })
62232024-11-14T17:06:17.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62242024-11-14T17:06:17.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62252024-11-14T17:06:17.705ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62262024-11-14T17:06:17.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62272024-11-14T17:06:17.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62282024-11-14T17:06:17.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62292024-11-14T17:06:17.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62302024-11-14T17:06:17.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62312024-11-14T17:06:17.729ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 1.020046404s iteration = 25 status = {}
62322024-11-14T17:06:18.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 339d0fa5-b9fe-46f6-8429-2b4ae7001285 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62332024-11-14T17:06:18.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 339d0fa5-b9fe-46f6-8429-2b4ae7001285 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62342024-11-14T17:06:18.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 339d0fa5-b9fe-46f6-8429-2b4ae7001285 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62352024-11-14T17:06:19.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f03e60e2-5f38-49d4-bfcf-99ac53b2384d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62362024-11-14T17:06:19.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f03e60e2-5f38-49d4-bfcf-99ac53b2384d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62372024-11-14T17:06:19.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f03e60e2-5f38-49d4-bfcf-99ac53b2384d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62382024-11-14T17:06:20.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f148f6f1-3c36-470a-9ef4-891e0e93e88a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62392024-11-14T17:06:20.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f148f6f1-3c36-470a-9ef4-891e0e93e88a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62402024-11-14T17:06:20.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f148f6f1-3c36-470a-9ef4-891e0e93e88a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62412024-11-14T17:06:21.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0f9cd9b4-e982-4502-835e-88b636cc7f37 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62422024-11-14T17:06:21.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0f9cd9b4-e982-4502-835e-88b636cc7f37 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62432024-11-14T17:06:21.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0f9cd9b4-e982-4502-835e-88b636cc7f37 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62442024-11-14T17:06:22.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9000ea6d-617c-408d-b54b-82060be727ed roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62452024-11-14T17:06:22.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9000ea6d-617c-408d-b54b-82060be727ed resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62462024-11-14T17:06:22.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9000ea6d-617c-408d-b54b-82060be727ed response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62472024-11-14T17:06:23.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1ac3c40c-b24c-48ad-b201-b2f81fcfd356 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62482024-11-14T17:06:23.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1ac3c40c-b24c-48ad-b201-b2f81fcfd356 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62492024-11-14T17:06:23.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1ac3c40c-b24c-48ad-b201-b2f81fcfd356 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62502024-11-14T17:06:24.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f4d80dd7-1522-4ec5-93d2-1bb9f543aa6c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62512024-11-14T17:06:24.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f4d80dd7-1522-4ec5-93d2-1bb9f543aa6c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62522024-11-14T17:06:24.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f4d80dd7-1522-4ec5-93d2-1bb9f543aa6c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62532024-11-14T17:06:25.153ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3f03c932-6347-4caf-8474-4a387a3f018e uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-14T17:06:25.150234417Z }
62542024-11-14T17:06:25.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3f03c932-6347-4caf-8474-4a387a3f018e roles = RoleSet { roles: {} } uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
62552024-11-14T17:06:25.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3f03c932-6347-4caf-8474-4a387a3f018e resource = Database result = Ok(()) uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
62562024-11-14T17:06:25.188ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:44785
62572024-11-14T17:06:25.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:44785 req_id = 3855dfb3-6098-4db0-a3c2-61d27be865e5 roles = RoleSet { roles: {} } uri = /metrics/producers
62582024-11-14T17:06:25.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:44785 req_id = 3855dfb3-6098-4db0-a3c2-61d27be865e5 resource = Database result = Ok(()) uri = /metrics/producers
62592024-11-14T17:06:25.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41270 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3f03c932-6347-4caf-8474-4a387a3f018e response_code = 204 uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
62602024-11-14T17:06:25.192ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a0c730ca-1d17-4909-ba9f-1a726658558b uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-14T17:06:25.192620493Z }
62612024-11-14T17:06:25.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a0c730ca-1d17-4909-ba9f-1a726658558b roles = RoleSet { roles: {} } uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
62622024-11-14T17:06:25.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a0c730ca-1d17-4909-ba9f-1a726658558b resource = Database result = Ok(()) uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
62632024-11-14T17:06:25.227ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = f6412a11-ec40-46d5-85bb-1b388201d9dd
62642024-11-14T17:06:25.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38353 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:44785 req_id = 3855dfb3-6098-4db0-a3c2-61d27be865e5 response_code = 201 uri = /metrics/producers
62652024-11-14T17:06:25.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42828 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a0c730ca-1d17-4909-ba9f-1a726658558b response_code = 204 uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
62662024-11-14T17:06:25.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4e53c478-7c04-45be-9157-fff3a897b0eb roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62672024-11-14T17:06:25.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4e53c478-7c04-45be-9157-fff3a897b0eb resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62682024-11-14T17:06:25.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4e53c478-7c04-45be-9157-fff3a897b0eb response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62692024-11-14T17:06:26.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 80c1e903-a13a-4fda-9e9d-6cf3674b4b48 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62702024-11-14T17:06:26.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 80c1e903-a13a-4fda-9e9d-6cf3674b4b48 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62712024-11-14T17:06:26.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 80c1e903-a13a-4fda-9e9d-6cf3674b4b48 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62722024-11-14T17:06:26.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 52ea7afd-98c7-4eab-ab5c-ab4b1a6ea1bd response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
62732024-11-14T17:06:26.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
62742024-11-14T17:06:26.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62752024-11-14T17:06:26.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
62762024-11-14T17:06:26.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62772024-11-14T17:06:26.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62782024-11-14T17:06:26.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62792024-11-14T17:06:26.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62802024-11-14T17:06:26.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62812024-11-14T17:06:26.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62822024-11-14T17:06:26.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62832024-11-14T17:06:26.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62842024-11-14T17:06:26.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62852024-11-14T17:06:26.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62862024-11-14T17:06:26.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
62872024-11-14T17:06:26.721ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62882024-11-14T17:06:26.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62892024-11-14T17:06:26.733ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
62902024-11-14T17:06:26.733ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.769384ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
62912024-11-14T17:06:26.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62922024-11-14T17:06:26.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62932024-11-14T17:06:26.767ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.797371ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62942024-11-14T17:06:27.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 003c914a-796e-49d4-88c2-319c788db721 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62952024-11-14T17:06:27.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 003c914a-796e-49d4-88c2-319c788db721 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62962024-11-14T17:06:27.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 003c914a-796e-49d4-88c2-319c788db721 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62972024-11-14T17:06:28.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6b718774-2d63-42f5-ab3a-dead1fbb8d29 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62982024-11-14T17:06:28.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6b718774-2d63-42f5-ab3a-dead1fbb8d29 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
62992024-11-14T17:06:28.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6b718774-2d63-42f5-ab3a-dead1fbb8d29 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63002024-11-14T17:06:29.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dd62ca4a-92fd-4b43-8791-ba716529cf3c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63012024-11-14T17:06:29.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dd62ca4a-92fd-4b43-8791-ba716529cf3c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63022024-11-14T17:06:29.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dd62ca4a-92fd-4b43-8791-ba716529cf3c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63032024-11-14T17:06:30.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d33ef270-af03-477f-a69e-c3c48185130e roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63042024-11-14T17:06:30.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d33ef270-af03-477f-a69e-c3c48185130e resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63052024-11-14T17:06:30.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d33ef270-af03-477f-a69e-c3c48185130e response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63062024-11-14T17:06:31.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4317efae-0671-4a9e-ba4e-9223a32d272f roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63072024-11-14T17:06:31.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4317efae-0671-4a9e-ba4e-9223a32d272f resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63082024-11-14T17:06:31.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4317efae-0671-4a9e-ba4e-9223a32d272f response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63092024-11-14T17:06:32.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2b826c04-f321-45db-8a9c-e19ef0ce5996 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63102024-11-14T17:06:32.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2b826c04-f321-45db-8a9c-e19ef0ce5996 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63112024-11-14T17:06:32.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2b826c04-f321-45db-8a9c-e19ef0ce5996 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63122024-11-14T17:06:33.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bec72078-6949-4a2f-a895-fb314edac901 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63132024-11-14T17:06:33.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bec72078-6949-4a2f-a895-fb314edac901 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63142024-11-14T17:06:33.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bec72078-6949-4a2f-a895-fb314edac901 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63152024-11-14T17:06:34.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = df83f970-ee74-402e-b569-d1a22d5c2695 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63162024-11-14T17:06:34.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = df83f970-ee74-402e-b569-d1a22d5c2695 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63172024-11-14T17:06:34.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = df83f970-ee74-402e-b569-d1a22d5c2695 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63182024-11-14T17:06:35.335ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ba30de4c-0f16-4314-a5f9-a06a54cf891d uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-14T17:06:35.334848678Z }
63192024-11-14T17:06:35.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ba30de4c-0f16-4314-a5f9-a06a54cf891d roles = RoleSet { roles: {} } uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63202024-11-14T17:06:35.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ba30de4c-0f16-4314-a5f9-a06a54cf891d resource = Database result = Ok(()) uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63212024-11-14T17:06:35.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33608 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ba30de4c-0f16-4314-a5f9-a06a54cf891d response_code = 204 uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63222024-11-14T17:06:35.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dc3b79cd-11c4-4e89-bc24-da7fe48bbe52 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63232024-11-14T17:06:35.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dc3b79cd-11c4-4e89-bc24-da7fe48bbe52 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63242024-11-14T17:06:35.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dc3b79cd-11c4-4e89-bc24-da7fe48bbe52 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63252024-11-14T17:06:36.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = d952e56a-67a2-49a3-aa29-bdfa2ab7e5ba roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
63262024-11-14T17:06:36.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = d952e56a-67a2-49a3-aa29-bdfa2ab7e5ba resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
63272024-11-14T17:06:36.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = d952e56a-67a2-49a3-aa29-bdfa2ab7e5ba response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
63282024-11-14T17:06:36.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 14b5068b-a347-4a54-a0aa-ff476dc3a215 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
63292024-11-14T17:06:36.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 14b5068b-a347-4a54-a0aa-ff476dc3a215 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
63302024-11-14T17:06:36.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 14b5068b-a347-4a54-a0aa-ff476dc3a215 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
63312024-11-14T17:06:36.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2fa3719c-abca-4197-b7c2-3ded7723ce50 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63322024-11-14T17:06:36.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2fa3719c-abca-4197-b7c2-3ded7723ce50 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63332024-11-14T17:06:36.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2fa3719c-abca-4197-b7c2-3ded7723ce50 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63342024-11-14T17:06:36.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
63352024-11-14T17:06:36.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
63362024-11-14T17:06:36.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63372024-11-14T17:06:36.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63382024-11-14T17:06:36.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63392024-11-14T17:06:36.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63402024-11-14T17:06:36.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63412024-11-14T17:06:36.713ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63422024-11-14T17:06:36.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63432024-11-14T17:06:36.715ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.642414ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63442024-11-14T17:06:36.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63452024-11-14T17:06:36.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63462024-11-14T17:06:36.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63472024-11-14T17:06:36.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63482024-11-14T17:06:36.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63492024-11-14T17:06:36.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63502024-11-14T17:06:36.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
63512024-11-14T17:06:36.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63522024-11-14T17:06:36.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63532024-11-14T17:06:36.732ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
63542024-11-14T17:06:36.732ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.084288ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
63552024-11-14T17:06:37.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = fb31e02a-50e1-46e9-a609-af08216c59ea roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
63562024-11-14T17:06:37.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = fb31e02a-50e1-46e9-a609-af08216c59ea resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
63572024-11-14T17:06:37.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = fb31e02a-50e1-46e9-a609-af08216c59ea response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
63582024-11-14T17:06:37.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e4907a72-6dc7-4b30-bdd4-fe43903f70af roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63592024-11-14T17:06:37.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e4907a72-6dc7-4b30-bdd4-fe43903f70af resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63602024-11-14T17:06:37.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e4907a72-6dc7-4b30-bdd4-fe43903f70af response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
63612024-11-14T17:06:37.837ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T17:06:37.837529143Z }
63622024-11-14T17:06:37.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 roles = RoleSet { roles: {} } uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63632024-11-14T17:06:37.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 resource = Database result = Ok(()) uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63642024-11-14T17:06:37.849ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f vmm_needs_update = true
63652024-11-14T17:06:37.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 roles = RoleSet { roles: {} } uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63662024-11-14T17:06:37.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 resource = Database result = Ok(()) uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63672024-11-14T17:06:37.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 roles = RoleSet { roles: {} } uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63682024-11-14T17:06:37.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 resource = Database result = Ok(()) uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63692024-11-14T17:06:37.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 roles = RoleSet { roles: {} } uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63702024-11-14T17:06:37.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 resource = Database result = Ok(()) uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63712024-11-14T17:06:37.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 roles = RoleSet { roles: {} } uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63722024-11-14T17:06:37.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 resource = Database result = Ok(()) uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63732024-11-14T17:06:37.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 roles = RoleSet { roles: {} } uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63742024-11-14T17:06:37.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 resource = Database result = Ok(()) uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63752024-11-14T17:06:37.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 roles = RoleSet { roles: {} } uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63762024-11-14T17:06:37.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 resource = Database result = Ok(()) uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63772024-11-14T17:06:37.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63782024-11-14T17:06:37.869ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 11404bb1-6f48-4205-9676-954f6fc87352, lookup_type: ById(11404bb1-6f48-4205-9676-954f6fc87352) }, key: 9639fc5c-8366-418e-a328-56348386625c, lookup_type: ById(9639fc5c-8366-418e-a328-56348386625c) }, key: f6412a11-ec40-46d5-85bb-1b388201d9dd, lookup_type: ById(f6412a11-ec40-46d5-85bb-1b388201d9dd) } result = Ok(()) uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63792024-11-14T17:06:37.869ZINFOnexus (dropshot_internal): starting update saga for f6412a11-ec40-46d5-85bb-1b388201d9dd actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T17:06:37.837529143Z }
63802024-11-14T17:06:37.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31334 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 response_code = 204 uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63812024-11-14T17:06:37.869ZDEBGnexus (dropshot_internal): preparing instance-update saga for f6412a11-ec40-46d5-85bb-1b388201d9dd... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = be77a679-0737-47ca-8188-3da75e5757f4 uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63822024-11-14T17:06:37.869ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update
63832024-11-14T17:06:37.869ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"f6412a11-ec40-46d5-85bb-1b388201d9dd","lookup_type":{"ById":"f6412a11-ec40-46d5-85bb-1b388201d9dd"},"parent":{"key":"9639fc5c-8366-418e-a328-56348386625c","lookup_type":{"ById":"9639fc5c-8366-418e-a328-56348386625c"},"parent":{"key":"11404bb1-6f48-4205-9676-954f6fc87352","lookup_type":{"ById":"11404bb1-6f48-4205-9676-954f6fc87352"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
63842024-11-14T17:06:37.869ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update
63852024-11-14T17:06:37.869ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fed4b7bb-d12d-4626-b5bb-f69dda751ebe uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T17:06:37.837529143Z }
63862024-11-14T17:06:37.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fed4b7bb-d12d-4626-b5bb-f69dda751ebe roles = RoleSet { roles: {} } uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63872024-11-14T17:06:37.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fed4b7bb-d12d-4626-b5bb-f69dda751ebe resource = Database result = Ok(()) uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63882024-11-14T17:06:37.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6721 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fed4b7bb-d12d-4626-b5bb-f69dda751ebe response_code = 204 uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
63892024-11-14T17:06:37.899ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update
63902024-11-14T17:06:37.899ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
63912024-11-14T17:06:37.899ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
63922024-11-14T17:06:37.899ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59
63932024-11-14T17:06:37.905ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
63942024-11-14T17:06:37.905ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59
63952024-11-14T17:06:37.910ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
63962024-11-14T17:06:37.910ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59
63972024-11-14T17:06:37.914ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
63982024-11-14T17:06:37.914ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("80000e68-5239-4029-9657-014ea76fc0f0")) node_id = 0 saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59
63992024-11-14T17:06:37.918ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
64002024-11-14T17:06:37.918ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59
64012024-11-14T17:06:37.921ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update
64022024-11-14T17:06:37.921ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64032024-11-14T17:06:37.922ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64042024-11-14T17:06:37.924ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64052024-11-14T17:06:37.924ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64062024-11-14T17:06:37.926ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64072024-11-14T17:06:37.926ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64082024-11-14T17:06:37.928ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64092024-11-14T17:06:37.928ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64102024-11-14T17:06:37.929ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64112024-11-14T17:06:37.930ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64122024-11-14T17:06:37.931ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64132024-11-14T17:06:37.931ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64142024-11-14T17:06:37.932ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64152024-11-14T17:06:37.936ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 11404bb1-6f48-4205-9676-954f6fc87352, lookup_type: ById(11404bb1-6f48-4205-9676-954f6fc87352) }, key: 9639fc5c-8366-418e-a328-56348386625c, lookup_type: ById(9639fc5c-8366-418e-a328-56348386625c) }, key: f6412a11-ec40-46d5-85bb-1b388201d9dd, lookup_type: ById(f6412a11-ec40-46d5-85bb-1b388201d9dd) } result = Ok(()) saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64162024-11-14T17:06:37.936ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance updater_id = 80000e68-5239-4029-9657-014ea76fc0f0
64172024-11-14T17:06:37.936ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64182024-11-14T17:06:37.936ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64192024-11-14T17:06:37.945ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance updater_id = 80000e68-5239-4029-9657-014ea76fc0f0
64202024-11-14T17:06:37.945ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64212024-11-14T17:06:37.945ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance
64222024-11-14T17:06:37.951ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd locked_gen = Generation(Generation(2)) saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = LockInstance updater_id = 80000e68-5239-4029-9657-014ea76fc0f0
64232024-11-14T17:06:37.954ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
64242024-11-14T17:06:37.954ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("80000e68-5239-4029-9657-014ea76fc0f0")}) node_id = 1 saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59
64252024-11-14T17:06:37.957ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
64262024-11-14T17:06:37.957ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59
64272024-11-14T17:06:37.961ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
64282024-11-14T17:06:37.961ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
64292024-11-14T17:06:37.962ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
64302024-11-14T17:06:37.963ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
64312024-11-14T17:06:37.964ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
64322024-11-14T17:06:37.964ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
64332024-11-14T17:06:37.965ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
64342024-11-14T17:06:37.968ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 11404bb1-6f48-4205-9676-954f6fc87352, lookup_type: ById(11404bb1-6f48-4205-9676-954f6fc87352) }, key: 9639fc5c-8366-418e-a328-56348386625c, lookup_type: ById(9639fc5c-8366-418e-a328-56348386625c) }, key: f6412a11-ec40-46d5-85bb-1b388201d9dd, lookup_type: ById(f6412a11-ec40-46d5-85bb-1b388201d9dd) } result = Ok(()) saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
64352024-11-14T17:06:37.968ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
64362024-11-14T17:06:37.968ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
64372024-11-14T17:06:37.974ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 29b656d1-a360-4276-b560-d0f74cefd58f, time_created: 2024-11-14T17:06:16.308357Z, time_deleted: None, instance_id: f6412a11-ec40-46d5-85bb-1b388201d9dd, sled_id: f70fbf74-7489-439f-8ec3-e6e8473a8b43, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-14T17:06:37.837529Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-14T17:06:14.204166Z, gen: Generation(Generation(3)), propolis_id: Some(29b656d1-a360-4276-b560-d0f74cefd58f), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(29b656d1-a360-4276-b560-d0f74cefd58f (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-14T17:06:37.974063243Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
64382024-11-14T17:06:37.974ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
64392024-11-14T17:06:37.974ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"f6412a11-ec40-46d5-85bb-1b388201d9dd","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"29b656d1-a360-4276-b560-d0f74cefd58f"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"f6412a11-ec40-46d5-85bb-1b388201d9dd","lookup_type":{"ById":"f6412a11-ec40-46d5-85bb-1b388201d9dd"},"parent":{"key":"9639fc5c-8366-418e-a328-56348386625c","lookup_type":{"ById":"9639fc5c-8366-418e-a328-56348386625c"},"parent":{"key":"11404bb1-6f48-4205-9676-954f6fc87352","lookup_type":{"ById":"11404bb1-6f48-4205-9676-954f6fc87352"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"80000e68-5239-4029-9657-014ea76fc0f0"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"9639fc5c-8366-418e-a328-56348386625c","ram_diff":1073741824},"destroy_active_vmm":"29b656d1-a360-4276-b560-d0f74cefd58f","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-14T17:06:37.974063243Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
64402024-11-14T17:06:37.974ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
64412024-11-14T17:06:38.005ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
64422024-11-14T17:06:38.005ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
64432024-11-14T17:06:38.005ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
64442024-11-14T17:06:38.005ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
64452024-11-14T17:06:38.009ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
64462024-11-14T17:06:38.009ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
64472024-11-14T17:06:38.013ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
64482024-11-14T17:06:38.013ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
64492024-11-14T17:06:38.015ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
64502024-11-14T17:06:38.015ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("0ea02f3e-29c3-471d-a14c-12e46d3957dc")) node_id = 0 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
64512024-11-14T17:06:38.018ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
64522024-11-14T17:06:38.018ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
64532024-11-14T17:06:38.026ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd parent_lock = UpdaterLock { updater_id: 80000e68-5239-4029-9657-014ea76fc0f0, locked_gen: Generation(Generation(2)) } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
64542024-11-14T17:06:38.026ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = BecomeUpdater
64552024-11-14T17:06:38.026ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = BecomeUpdater
64562024-11-14T17:06:38.036ZDEBGnexus (SagaExecutor): inherited lock from 80000e68-5239-4029-9657-014ea76fc0f0 to 0ea02f3e-29c3-471d-a14c-12e46d3957dc actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 80000e68-5239-4029-9657-014ea76fc0f0 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = BecomeUpdater updater_id = 0ea02f3e-29c3-471d-a14c-12e46d3957dc
64572024-11-14T17:06:38.037ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
64582024-11-14T17:06:38.037ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
64592024-11-14T17:06:38.037ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("0ea02f3e-29c3-471d-a14c-12e46d3957dc")}) node_id = 1 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
64602024-11-14T17:06:38.044ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
64612024-11-14T17:06:38.044ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
64622024-11-14T17:06:38.048ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
64632024-11-14T17:06:38.048ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
64642024-11-14T17:06:38.051ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
64652024-11-14T17:06:38.051ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
64662024-11-14T17:06:38.056ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
64672024-11-14T17:06:38.058ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd
64682024-11-14T17:06:38.060ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = UpdateNetworkConfig
64692024-11-14T17:06:38.061ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = UpdateNetworkConfig
64702024-11-14T17:06:38.063ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = UpdateNetworkConfig
64712024-11-14T17:06:38.063ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = UpdateNetworkConfig
64722024-11-14T17:06:38.065ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
64732024-11-14T17:06:38.065ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = UpdateNetworkConfig
64742024-11-14T17:06:38.065ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = UpdateNetworkConfig
64752024-11-14T17:06:38.068ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
64762024-11-14T17:06:38.068ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
64772024-11-14T17:06:38.068ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
64782024-11-14T17:06:38.069ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
64792024-11-14T17:06:38.070ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
64802024-11-14T17:06:38.071ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
64812024-11-14T17:06:38.071ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
64822024-11-14T17:06:38.075ZDEBGnexus: notifying dendrite of updates instance_id = Some(f6412a11-ec40-46d5-85bb-1b388201d9dd (instance)) switch = switch0
64832024-11-14T17:06:38.076ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2521, tv_nsec: 805029956 } })
64842024-11-14T17:06:38.076ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
64852024-11-14T17:06:38.106ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
64862024-11-14T17:06:38.106ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64872024-11-14T17:06:38.107ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6378f419-f470-48a2-b685-d35fc98c686c", "content-length": "26", "date": "Thu, 14 Nov 2024 17:06:38 GMT"} })
64882024-11-14T17:06:38.107ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64892024-11-14T17:06:38.108ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64902024-11-14T17:06:38.137ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
64912024-11-14T17:06:38.137ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "a701e073-2ffc-4047-b19b-2502b95efed3", "content-length": "4", "date": "Thu, 14 Nov 2024 17:06:37 GMT"} })
64922024-11-14T17:06:38.139ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
64932024-11-14T17:06:38.139ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
64942024-11-14T17:06:38.142ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
64952024-11-14T17:06:38.142ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
64962024-11-14T17:06:38.148ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = ReleaseVirtualProvisioning
64972024-11-14T17:06:38.148ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = ReleaseVirtualProvisioning
64982024-11-14T17:06:38.164ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-14T17:06:38.151126Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 11404bb1-6f48-4205-9676-954f6fc87352, time_modified: Some(2024-11-14T17:06:38.151126Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 9639fc5c-8366-418e-a328-56348386625c, time_modified: Some(2024-11-14T17:06:38.151126Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
64992024-11-14T17:06:38.164ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65002024-11-14T17:06:38.164ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65012024-11-14T17:06:38.167ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65022024-11-14T17:06:38.167ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65032024-11-14T17:06:38.170ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
65042024-11-14T17:06:38.172ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = UnassignOximeterProducer
65052024-11-14T17:06:38.173ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = UnassignOximeterProducer
65062024-11-14T17:06:38.177ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 producer_id = f6412a11-ec40-46d5-85bb-1b388201d9dd saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
65072024-11-14T17:06:38.177ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = UnassignOximeterProducer
65082024-11-14T17:06:38.177ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = UnassignOximeterProducer
65092024-11-14T17:06:38.212ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = f6412a11-ec40-46d5-85bb-1b388201d9dd saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
65102024-11-14T17:06:38.215ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = f6412a11-ec40-46d5-85bb-1b388201d9dd saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/f6412a11-ec40-46d5-85bb-1b388201d9dd
65112024-11-14T17:06:38.230ZDEBGnexus (SagaExecutor): client response oximeter-collector = f6412a11-ec40-46d5-85bb-1b388201d9dd result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/f6412a11-ec40-46d5-85bb-1b388201d9dd", status: 204, headers: {"x-request-id": "42637f99-6e20-4822-83b0-d7d425141c27", "date": "Thu, 14 Nov 2024 17:06:38 GMT"} }) saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
65122024-11-14T17:06:38.230ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 producer_id = f6412a11-ec40-46d5-85bb-1b388201d9dd saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
65132024-11-14T17:06:38.232ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65142024-11-14T17:06:38.232ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65152024-11-14T17:06:38.236ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65162024-11-14T17:06:38.236ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65172024-11-14T17:06:38.239ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd lock = UpdaterLock { updater_id: 0ea02f3e-29c3-471d-a14c-12e46d3957dc, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-14T17:06:37.974063243Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
65182024-11-14T17:06:38.239ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = CommitInstanceUpdates
65192024-11-14T17:06:38.239ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = CommitInstanceUpdates
65202024-11-14T17:06:38.253ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd new_runtime = InstanceRuntimeState { time_updated: 2024-11-14T17:06:37.974063243Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
65212024-11-14T17:06:38.253ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65222024-11-14T17:06:38.253ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65232024-11-14T17:06:38.253ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
65242024-11-14T17:06:38.253ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
65252024-11-14T17:06:38.253ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
65262024-11-14T17:06:38.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65272024-11-14T17:06:38.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65282024-11-14T17:06:38.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65292024-11-14T17:06:38.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65302024-11-14T17:06:38.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65312024-11-14T17:06:38.257ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65322024-11-14T17:06:38.257ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65332024-11-14T17:06:38.257ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65342024-11-14T17:06:38.257ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65352024-11-14T17:06:38.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65362024-11-14T17:06:38.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65372024-11-14T17:06:38.260ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65382024-11-14T17:06:38.261ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("f6412a11-ec40-46d5-85bb-1b388201d9dd"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("29b656d1-a360-4276-b560-d0f74cefd58f")}) node_id = 7 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65392024-11-14T17:06:38.261ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65402024-11-14T17:06:38.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65412024-11-14T17:06:38.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65422024-11-14T17:06:38.264ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65432024-11-14T17:06:38.264ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65442024-11-14T17:06:38.267ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65452024-11-14T17:06:38.267ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65462024-11-14T17:06:38.270ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65472024-11-14T17:06:38.270ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65482024-11-14T17:06:38.275ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
65492024-11-14T17:06:38.276ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = ReleaseSledResources
65502024-11-14T17:06:38.276ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = ReleaseSledResources
65512024-11-14T17:06:38.283ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65522024-11-14T17:06:38.283ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65532024-11-14T17:06:38.286ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65542024-11-14T17:06:38.286ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65552024-11-14T17:06:38.289ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
65562024-11-14T17:06:38.289ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = MarkVmmDeleted
65572024-11-14T17:06:38.290ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = MarkVmmDeleted
65582024-11-14T17:06:38.330ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65592024-11-14T17:06:38.330ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65602024-11-14T17:06:38.331ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65612024-11-14T17:06:38.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65622024-11-14T17:06:38.333ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65632024-11-14T17:06:38.333ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65642024-11-14T17:06:38.336ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65652024-11-14T17:06:38.336ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65662024-11-14T17:06:38.340ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65672024-11-14T17:06:38.340ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65682024-11-14T17:06:38.344ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = ChainSuccessorSaga
65692024-11-14T17:06:38.345ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = ChainSuccessorSaga
65702024-11-14T17:06:38.346ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = ChainSuccessorSaga
65712024-11-14T17:06:38.347ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = ChainSuccessorSaga
65722024-11-14T17:06:38.348ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = ChainSuccessorSaga
65732024-11-14T17:06:38.348ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = ChainSuccessorSaga
65742024-11-14T17:06:38.349ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = ChainSuccessorSaga
65752024-11-14T17:06:38.352ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 11404bb1-6f48-4205-9676-954f6fc87352, lookup_type: ById(11404bb1-6f48-4205-9676-954f6fc87352) }, key: 9639fc5c-8366-418e-a328-56348386625c, lookup_type: ById(9639fc5c-8366-418e-a328-56348386625c) }, key: f6412a11-ec40-46d5-85bb-1b388201d9dd, lookup_type: ById(f6412a11-ec40-46d5-85bb-1b388201d9dd) } result = Ok(()) saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = ChainSuccessorSaga
65762024-11-14T17:06:38.352ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = ChainSuccessorSaga
65772024-11-14T17:06:38.353ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_node = ChainSuccessorSaga
65782024-11-14T17:06:38.353ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
65792024-11-14T17:06:38.353ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65802024-11-14T17:06:38.353ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7d8cc03-55b0-434a-a340-de16ceb44b6f", "content-length": "372", "date": "Thu, 14 Nov 2024 17:06:38 GMT"} })
65812024-11-14T17:06:38.353ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65822024-11-14T17:06:38.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65832024-11-14T17:06:38.355ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update
65842024-11-14T17:06:38.355ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65852024-11-14T17:06:38.355ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65862024-11-14T17:06:38.355ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Signaled
65872024-11-14T17:06:38.355ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65882024-11-14T17:06:38.355ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65892024-11-14T17:06:38.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65902024-11-14T17:06:38.359ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65912024-11-14T17:06:38.359ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65922024-11-14T17:06:38.361ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65932024-11-14T17:06:38.361ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65942024-11-14T17:06:38.365ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
65952024-11-14T17:06:38.365ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d
65962024-11-14T17:06:38.368ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65972024-11-14T17:06:38.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65982024-11-14T17:06:38.369ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65992024-11-14T17:06:38.371ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66002024-11-14T17:06:38.371ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66012024-11-14T17:06:38.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66022024-11-14T17:06:38.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66032024-11-14T17:06:38.375ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66042024-11-14T17:06:38.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66052024-11-14T17:06:38.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66062024-11-14T17:06:38.387ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66072024-11-14T17:06:38.387ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
66082024-11-14T17:06:38.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66092024-11-14T17:06:38.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66102024-11-14T17:06:38.390ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66112024-11-14T17:06:38.390ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66122024-11-14T17:06:38.390ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66132024-11-14T17:06:38.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66142024-11-14T17:06:38.408ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
66152024-11-14T17:06:38.408ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
66162024-11-14T17:06:38.408ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bf3cb41e-b0fc-4ae6-a865-d7c268cf6c3b", "date": "Thu, 14 Nov 2024 17:06:38 GMT"} })
66172024-11-14T17:06:38.408ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66182024-11-14T17:06:38.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66192024-11-14T17:06:38.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66202024-11-14T17:06:38.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66212024-11-14T17:06:38.416ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66222024-11-14T17:06:38.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66232024-11-14T17:06:38.417ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
66242024-11-14T17:06:38.417ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d saga_name = instance-update saga_result = SagaResult { saga_id: c7eae5b8-6e5f-447b-a64b-815dbd707f2d, saga_log: SagaLog { saga_id: c7eae5b8-6e5f-447b-a64b-815dbd707f2d, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("0ea02f3e-29c3-471d-a14c-12e46d3957dc")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("0ea02f3e-29c3-471d-a14c-12e46d3957dc")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("f6412a11-ec40-46d5-85bb-1b388201d9dd"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("29b656d1-a360-4276-b560-d0f74cefd58f")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("f6412a11-ec40-46d5-85bb-1b388201d9dd"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("29b656d1-a360-4276-b560-d0f74cefd58f")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("0ea02f3e-29c3-471d-a14c-12e46d3957dc"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("0ea02f3e-29c3-471d-a14c-12e46d3957dc")}} }) }
66252024-11-14T17:06:38.417ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = c7eae5b8-6e5f-447b-a64b-815dbd707f2d instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update
66262024-11-14T17:06:38.417ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
66272024-11-14T17:06:38.417ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59
66282024-11-14T17:06:38.420ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
66292024-11-14T17:06:38.420ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66302024-11-14T17:06:38.420ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c009ff78-1e21-4a79-b5b2-a864add1ab52", "date": "Thu, 14 Nov 2024 17:06:38 GMT"} })
66312024-11-14T17:06:38.421ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
66322024-11-14T17:06:38.421ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59
66332024-11-14T17:06:38.423ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 169.189698ms iteration = 27 status = {}
66342024-11-14T17:06:38.423ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66352024-11-14T17:06:38.423ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66362024-11-14T17:06:38.423ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 68.024094ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
66372024-11-14T17:06:38.425ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
66382024-11-14T17:06:38.425ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59
66392024-11-14T17:06:38.428ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
66402024-11-14T17:06:38.428ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59
66412024-11-14T17:06:38.434ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update sec_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
66422024-11-14T17:06:38.434ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 24038ebf-4c07-435f-a8db-2883f549ea59 saga_name = start-instance-update saga_result = SagaResult { saga_id: 24038ebf-4c07-435f-a8db-2883f549ea59, saga_log: SagaLog { saga_id: 24038ebf-4c07-435f-a8db-2883f549ea59, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("80000e68-5239-4029-9657-014ea76fc0f0")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("80000e68-5239-4029-9657-014ea76fc0f0")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("80000e68-5239-4029-9657-014ea76fc0f0"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("80000e68-5239-4029-9657-014ea76fc0f0")}} }) }
66432024-11-14T17:06:38.478ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
66442024-11-14T17:06:38.478ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "80eb21dd-8a34-4084-9e1e-7f5fff9b0ce1", "content-length": "691", "date": "Thu, 14 Nov 2024 17:06:38 GMT"} })
66452024-11-14T17:06:38.478ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
66462024-11-14T17:06:38.479ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
66472024-11-14T17:06:38.479ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
66482024-11-14T17:06:38.480ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 226.891459ms iteration = 26 status = {}
66492024-11-14T17:06:38.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 5f034abc-9ec8-4ccb-9ceb-b79613965177 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
66502024-11-14T17:06:38.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 5f034abc-9ec8-4ccb-9ceb-b79613965177 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
66512024-11-14T17:06:38.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 5f034abc-9ec8-4ccb-9ceb-b79613965177 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
66522024-11-14T17:06:38.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5259eda3-0dfc-4425-9c46-015e2b9981a2 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66532024-11-14T17:06:38.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5259eda3-0dfc-4425-9c46-015e2b9981a2 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66542024-11-14T17:06:38.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5259eda3-0dfc-4425-9c46-015e2b9981a2 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66552024-11-14T17:06:39.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9edb53f0-5575-4ead-a307-0903e558d69a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66562024-11-14T17:06:39.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9edb53f0-5575-4ead-a307-0903e558d69a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66572024-11-14T17:06:39.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9edb53f0-5575-4ead-a307-0903e558d69a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66582024-11-14T17:06:40.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9e5e87b0-d126-43d3-a69f-1a258943970c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66592024-11-14T17:06:40.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9e5e87b0-d126-43d3-a69f-1a258943970c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66602024-11-14T17:06:40.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9e5e87b0-d126-43d3-a69f-1a258943970c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66612024-11-14T17:06:41.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = c7ffaace-3790-4d8d-9150-96f264b1b5ab response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
66622024-11-14T17:06:41.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 17469502-404a-4a83-a141-8406a08b85e9 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66632024-11-14T17:06:41.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 17469502-404a-4a83-a141-8406a08b85e9 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66642024-11-14T17:06:41.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 17469502-404a-4a83-a141-8406a08b85e9 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66652024-11-14T17:06:42.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 97e7f7cb-4a7e-4b86-8612-0f8f048ac745 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66662024-11-14T17:06:42.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 97e7f7cb-4a7e-4b86-8612-0f8f048ac745 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66672024-11-14T17:06:42.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 97e7f7cb-4a7e-4b86-8612-0f8f048ac745 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66682024-11-14T17:06:43.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 36bbd590-8afe-437e-a967-b1615388325c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66692024-11-14T17:06:43.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 36bbd590-8afe-437e-a967-b1615388325c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66702024-11-14T17:06:43.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 36bbd590-8afe-437e-a967-b1615388325c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66712024-11-14T17:06:44.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a7e055aa-599b-48e4-8d6c-0f6756781eb8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66722024-11-14T17:06:44.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a7e055aa-599b-48e4-8d6c-0f6756781eb8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66732024-11-14T17:06:44.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a7e055aa-599b-48e4-8d6c-0f6756781eb8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66742024-11-14T17:06:45.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4652fad8-8481-4e14-a3e0-7c241e441dcb roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66752024-11-14T17:06:45.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4652fad8-8481-4e14-a3e0-7c241e441dcb resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66762024-11-14T17:06:45.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4652fad8-8481-4e14-a3e0-7c241e441dcb response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
66772024-11-14T17:06:46.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 59f480a7-9e0c-4149-ae35-fd0d661f93c3 roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
66782024-11-14T17:06:46.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 59f480a7-9e0c-4149-ae35-fd0d661f93c3 resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
66792024-11-14T17:06:46.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 59f480a7-9e0c-4149-ae35-fd0d661f93c3 response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
66802024-11-14T17:06:46.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = b8d7ffe0-6360-4bff-9480-9d3a76b39d65 roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
66812024-11-14T17:06:46.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = b8d7ffe0-6360-4bff-9480-9d3a76b39d65 resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
66822024-11-14T17:06:46.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = b8d7ffe0-6360-4bff-9480-9d3a76b39d65 response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
66832024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
66842024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
66852024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66862024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66872024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
66882024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66892024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
66902024-11-14T17:06:46.710ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
66912024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
66922024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66932024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66942024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
66952024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66962024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
66972024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66982024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
66992024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67002024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
67012024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
67022024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
67032024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67042024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
67052024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67062024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
67072024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
67082024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67092024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67102024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
67112024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
67122024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67132024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
67142024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
67152024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
67162024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
67172024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67182024-11-14T17:06:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67192024-11-14T17:06:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67202024-11-14T17:06:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67212024-11-14T17:06:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67222024-11-14T17:06:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67232024-11-14T17:06:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67242024-11-14T17:06:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67252024-11-14T17:06:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67262024-11-14T17:06:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67272024-11-14T17:06:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67282024-11-14T17:06:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67292024-11-14T17:06:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67302024-11-14T17:06:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67312024-11-14T17:06:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67322024-11-14T17:06:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67332024-11-14T17:06:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67342024-11-14T17:06:46.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67352024-11-14T17:06:46.714ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67362024-11-14T17:06:46.714ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67372024-11-14T17:06:46.715ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.809378ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67382024-11-14T17:06:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67392024-11-14T17:06:46.716ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67402024-11-14T17:06:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67412024-11-14T17:06:46.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67422024-11-14T17:06:46.717ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67432024-11-14T17:06:46.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67442024-11-14T17:06:46.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67452024-11-14T17:06:46.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67462024-11-14T17:06:46.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67472024-11-14T17:06:46.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67482024-11-14T17:06:46.724ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2530, tv_nsec: 452856315 } })
67492024-11-14T17:06:46.724ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
67502024-11-14T17:06:46.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67512024-11-14T17:06:46.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67522024-11-14T17:06:46.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67532024-11-14T17:06:46.726ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2530, tv_nsec: 455432233 } })
67542024-11-14T17:06:46.727ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
67552024-11-14T17:06:46.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 33.468805ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
67562024-11-14T17:06:46.750ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67572024-11-14T17:06:46.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67582024-11-14T17:06:46.750ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2530, tv_nsec: 479446735 } })
67592024-11-14T17:06:46.751ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
67602024-11-14T17:06:46.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67612024-11-14T17:06:46.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67622024-11-14T17:06:46.776ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67632024-11-14T17:06:46.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67642024-11-14T17:06:46.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67652024-11-14T17:06:46.778ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67662024-11-14T17:06:46.779ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67672024-11-14T17:06:46.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67682024-11-14T17:06:46.780ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67692024-11-14T17:06:46.781ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67702024-11-14T17:06:46.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67712024-11-14T17:06:46.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67722024-11-14T17:06:46.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67732024-11-14T17:06:46.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67742024-11-14T17:06:46.783ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67752024-11-14T17:06:46.783ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 73.249123ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67762024-11-14T17:06:46.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67772024-11-14T17:06:46.785ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67782024-11-14T17:06:46.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67792024-11-14T17:06:46.787ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67802024-11-14T17:06:46.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67812024-11-14T17:06:46.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67822024-11-14T17:06:46.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67832024-11-14T17:06:46.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67842024-11-14T17:06:46.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 91.585766ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
67852024-11-14T17:06:46.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67862024-11-14T17:06:46.802ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67872024-11-14T17:06:46.802ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
67882024-11-14T17:06:46.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67892024-11-14T17:06:46.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67902024-11-14T17:06:46.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67912024-11-14T17:06:46.804ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
67922024-11-14T17:06:46.804ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 94.014241ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
67932024-11-14T17:06:46.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
67942024-11-14T17:06:46.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67952024-11-14T17:06:46.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67962024-11-14T17:06:46.806ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67972024-11-14T17:06:46.806ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
67982024-11-14T17:06:46.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67992024-11-14T17:06:46.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68002024-11-14T17:06:46.807ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
68012024-11-14T17:06:46.807ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68022024-11-14T17:06:46.807ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f24d26b-373f-48cf-8387-8352414f8c56", "content-length": "26", "date": "Thu, 14 Nov 2024 17:06:46 GMT"} })
68032024-11-14T17:06:46.807ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68042024-11-14T17:06:46.810ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68052024-11-14T17:06:46.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68062024-11-14T17:06:46.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
68072024-11-14T17:06:46.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 115.063187ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
68082024-11-14T17:06:46.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 115.159388ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68092024-11-14T17:06:46.826ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
68102024-11-14T17:06:46.826ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68112024-11-14T17:06:46.826ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1a0063c-c0b4-48a0-be3e-60bf802e05b3", "content-length": "26", "date": "Thu, 14 Nov 2024 17:06:46 GMT"} })
68122024-11-14T17:06:46.826ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68132024-11-14T17:06:46.826ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68142024-11-14T17:06:46.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68152024-11-14T17:06:46.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68162024-11-14T17:06:46.828ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68172024-11-14T17:06:46.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68182024-11-14T17:06:46.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68192024-11-14T17:06:46.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68202024-11-14T17:06:46.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68212024-11-14T17:06:46.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68222024-11-14T17:06:46.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
68232024-11-14T17:06:46.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68242024-11-14T17:06:46.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68252024-11-14T17:06:46.846ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 136.52809ms iteration = 26 status = 0
68262024-11-14T17:06:46.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 140.041719ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
68272024-11-14T17:06:46.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68282024-11-14T17:06:46.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68292024-11-14T17:06:46.862ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
68302024-11-14T17:06:46.862ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68312024-11-14T17:06:46.862ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fddbb154-fa48-4ae9-b7b1-c8ace001bd43", "content-length": "26", "date": "Thu, 14 Nov 2024 17:06:46 GMT"} })
68322024-11-14T17:06:46.862ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68332024-11-14T17:06:46.862ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68342024-11-14T17:06:46.862ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68352024-11-14T17:06:46.862ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 152.138073ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68362024-11-14T17:06:46.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6b1b1320-07ac-4d8e-9b6d-19cdc4be104b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
68372024-11-14T17:06:46.864ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
68382024-11-14T17:06:46.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6b1b1320-07ac-4d8e-9b6d-19cdc4be104b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
68392024-11-14T17:06:46.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2762 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6b1b1320-07ac-4d8e-9b6d-19cdc4be104b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
68402024-11-14T17:06:46.877ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68412024-11-14T17:06:46.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68422024-11-14T17:06:46.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 203.721006ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
68432024-11-14T17:06:46.975ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 265.213654ms iteration = 30 status = {"physical_disks_added":0}
68442024-11-14T17:06:46.993ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68452024-11-14T17:06:46.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68462024-11-14T17:06:46.994ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68472024-11-14T17:06:46.994ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "997912dc-6ba7-4aee-943b-6aeb8a03426c", "content-length": "2", "date": "Thu, 14 Nov 2024 17:06:46 GMT"} })
68482024-11-14T17:06:46.995ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68492024-11-14T17:06:46.996ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68502024-11-14T17:06:46.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68512024-11-14T17:06:46.998ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68522024-11-14T17:06:46.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68532024-11-14T17:06:46.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68542024-11-14T17:06:46.998ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 287.852685ms iteration = 26 status = null
68552024-11-14T17:06:47.034ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
68562024-11-14T17:06:47.034ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68572024-11-14T17:06:47.035ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "061467ce-b581-49cb-8553-80e0c8537782", "content-length": "372", "date": "Thu, 14 Nov 2024 17:06:47 GMT"} })
68582024-11-14T17:06:47.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68592024-11-14T17:06:47.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68602024-11-14T17:06:47.035ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 324.85389ms iteration = 26 status = {}
68612024-11-14T17:06:47.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68622024-11-14T17:06:47.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68632024-11-14T17:06:47.037ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68642024-11-14T17:06:47.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68652024-11-14T17:06:47.049ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
68662024-11-14T17:06:47.049ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
68672024-11-14T17:06:47.049ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6b3377e0-ac89-4650-b633-7cac4b8797d8", "date": "Thu, 14 Nov 2024 17:06:47 GMT"} })
68682024-11-14T17:06:47.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68692024-11-14T17:06:47.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68702024-11-14T17:06:47.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68712024-11-14T17:06:47.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68722024-11-14T17:06:47.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68732024-11-14T17:06:47.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68742024-11-14T17:06:47.061ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
68752024-11-14T17:06:47.061ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68762024-11-14T17:06:47.062ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "01e76b0e-d5f8-4245-8517-2604db99c3a5", "date": "Thu, 14 Nov 2024 17:06:47 GMT"} })
68772024-11-14T17:06:47.063ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 353.441344ms iteration = 28 status = {}
68782024-11-14T17:06:47.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68792024-11-14T17:06:47.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68802024-11-14T17:06:47.087ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
68812024-11-14T17:06:47.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68822024-11-14T17:06:47.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68832024-11-14T17:06:47.098ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68842024-11-14T17:06:47.098ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8919fe4e-f5f7-4dab-a064-c43366db9dfa", "content-length": "134", "date": "Thu, 14 Nov 2024 17:06:46 GMT"} })
68852024-11-14T17:06:47.098ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
68862024-11-14T17:06:47.098ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
68872024-11-14T17:06:47.098ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
68882024-11-14T17:06:47.098ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68892024-11-14T17:06:47.098ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68902024-11-14T17:06:47.098ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68912024-11-14T17:06:47.098ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68922024-11-14T17:06:47.098ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68932024-11-14T17:06:47.098ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68942024-11-14T17:06:47.098ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68952024-11-14T17:06:47.098ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
68962024-11-14T17:06:47.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68972024-11-14T17:06:47.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68982024-11-14T17:06:47.101ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
68992024-11-14T17:06:47.101ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "25d04ca0-6e54-4bc5-ab60-2396bac99c46", "content-length": "2", "date": "Thu, 14 Nov 2024 17:06:46 GMT"} })
69002024-11-14T17:06:47.101ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
69012024-11-14T17:06:47.101ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5581ddc-0d1b-4bed-8027-e6a929ce365c", "content-length": "52", "date": "Thu, 14 Nov 2024 17:06:46 GMT"} })
69022024-11-14T17:06:47.101ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
69032024-11-14T17:06:47.101ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
69042024-11-14T17:06:47.128ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69052024-11-14T17:06:47.218ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f62c83b7-981d-4635-95f7-969f5d9703f2", "date": "Thu, 14 Nov 2024 17:06:47 GMT"} })
69062024-11-14T17:06:47.218ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
69072024-11-14T17:06:47.218ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
69082024-11-14T17:06:47.218ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc564f8b-056d-412f-94a1-47944a38ea50", "content-length": "682", "date": "Thu, 14 Nov 2024 17:06:47 GMT"} })
69092024-11-14T17:06:47.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69102024-11-14T17:06:47.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69112024-11-14T17:06:47.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69122024-11-14T17:06:47.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69132024-11-14T17:06:47.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69142024-11-14T17:06:47.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69152024-11-14T17:06:47.226ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0cb8b4e4-e1dd-44da-9b94-c5004556a42e", "content-length": "691", "date": "Thu, 14 Nov 2024 17:06:47 GMT"} })
69162024-11-14T17:06:47.226ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
69172024-11-14T17:06:47.226ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
69182024-11-14T17:06:47.226ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
69192024-11-14T17:06:47.228ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 517.839904ms iteration = 27 status = {}
69202024-11-14T17:06:47.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69212024-11-14T17:06:47.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69222024-11-14T17:06:47.235ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 525.395634ms iteration = 26 status = {}
69232024-11-14T17:06:47.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ca3779a2-971e-4966-8274-98e064d1a21a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69242024-11-14T17:06:47.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ca3779a2-971e-4966-8274-98e064d1a21a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69252024-11-14T17:06:47.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2749 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ca3779a2-971e-4966-8274-98e064d1a21a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69262024-11-14T17:06:48.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2338287b-2725-46c1-ba78-0de2818997cf roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69272024-11-14T17:06:48.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2338287b-2725-46c1-ba78-0de2818997cf resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69282024-11-14T17:06:48.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2609 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2338287b-2725-46c1-ba78-0de2818997cf response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69292024-11-14T17:06:49.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5efc60e3-d9e7-45fe-8549-6c384bdb4f45 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69302024-11-14T17:06:49.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5efc60e3-d9e7-45fe-8549-6c384bdb4f45 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69312024-11-14T17:06:49.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5efc60e3-d9e7-45fe-8549-6c384bdb4f45 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69322024-11-14T17:06:50.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8bb21530-a6af-4227-b9ab-47c2e47c1ad8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69332024-11-14T17:06:50.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8bb21530-a6af-4227-b9ab-47c2e47c1ad8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69342024-11-14T17:06:50.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8bb21530-a6af-4227-b9ab-47c2e47c1ad8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69352024-11-14T17:06:51.246ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:33937
69362024-11-14T17:06:51.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33937 req_id = a48de88f-df8b-461c-9b1a-3c3efca8dea0 roles = RoleSet { roles: {} } uri = /metrics/producers
69372024-11-14T17:06:51.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33937 req_id = a48de88f-df8b-461c-9b1a-3c3efca8dea0 resource = Database result = Ok(()) uri = /metrics/producers
69382024-11-14T17:06:51.283ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = 743a3e75-8669-4b5c-90ad-c360bf17cd8e
69392024-11-14T17:06:51.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37107 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33937 req_id = a48de88f-df8b-461c-9b1a-3c3efca8dea0 response_code = 201 uri = /metrics/producers
69402024-11-14T17:06:51.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 115ffdfa-3364-4cee-8e21-a54d92240660 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69412024-11-14T17:06:51.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 115ffdfa-3364-4cee-8e21-a54d92240660 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69422024-11-14T17:06:51.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 115ffdfa-3364-4cee-8e21-a54d92240660 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69432024-11-14T17:06:53.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e557be4d-77c7-495f-8e60-c35dd84d5c07 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69442024-11-14T17:06:53.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e557be4d-77c7-495f-8e60-c35dd84d5c07 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69452024-11-14T17:06:53.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2627 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e557be4d-77c7-495f-8e60-c35dd84d5c07 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69462024-11-14T17:06:54.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6ea95b02-a95c-46d4-b16f-44bed57e9cf6 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69472024-11-14T17:06:54.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6ea95b02-a95c-46d4-b16f-44bed57e9cf6 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69482024-11-14T17:06:54.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2627 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6ea95b02-a95c-46d4-b16f-44bed57e9cf6 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69492024-11-14T17:06:55.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c3689256-c266-48c9-b099-dc2d589122f0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69502024-11-14T17:06:55.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c3689256-c266-48c9-b099-dc2d589122f0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69512024-11-14T17:06:55.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c3689256-c266-48c9-b099-dc2d589122f0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69522024-11-14T17:06:56.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 083d29de-978e-4ed7-821c-54c8f806259a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69532024-11-14T17:06:56.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 083d29de-978e-4ed7-821c-54c8f806259a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69542024-11-14T17:06:56.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 083d29de-978e-4ed7-821c-54c8f806259a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69552024-11-14T17:06:56.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 4a4d3a48-fc6e-4583-b77b-d4db05c53be6 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
69562024-11-14T17:06:56.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
69572024-11-14T17:06:56.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69582024-11-14T17:06:56.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
69592024-11-14T17:06:56.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69602024-11-14T17:06:56.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69612024-11-14T17:06:56.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69622024-11-14T17:06:56.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69632024-11-14T17:06:56.713ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69642024-11-14T17:06:56.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69652024-11-14T17:06:56.715ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.811218ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69662024-11-14T17:06:56.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69672024-11-14T17:06:56.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69682024-11-14T17:06:56.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69692024-11-14T17:06:56.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69702024-11-14T17:06:56.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69712024-11-14T17:06:56.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69722024-11-14T17:06:56.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
69732024-11-14T17:06:56.720ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69742024-11-14T17:06:56.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69752024-11-14T17:06:56.732ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
69762024-11-14T17:06:56.732ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.092488ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
69772024-11-14T17:06:57.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 30b8d8b2-201f-4835-a082-e0d8214b315b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69782024-11-14T17:06:57.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 30b8d8b2-201f-4835-a082-e0d8214b315b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69792024-11-14T17:06:57.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 30b8d8b2-201f-4835-a082-e0d8214b315b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69802024-11-14T17:06:57.227ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:41063
69812024-11-14T17:06:57.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41063 req_id = 65fd0936-f9e3-4f44-8d31-f2d98ffdbdd1 roles = RoleSet { roles: {} } uri = /metrics/producers
69822024-11-14T17:06:57.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41063 req_id = 65fd0936-f9e3-4f44-8d31-f2d98ffdbdd1 resource = Database result = Ok(()) uri = /metrics/producers
69832024-11-14T17:06:57.266ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = 6bd40b29-f0a0-4b84-a1e1-0a83cff94df0
69842024-11-14T17:06:57.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38902 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41063 req_id = 65fd0936-f9e3-4f44-8d31-f2d98ffdbdd1 response_code = 201 uri = /metrics/producers
69852024-11-14T17:06:58.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = db975ff8-becf-49d7-a34a-876d7d1b2aed roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69862024-11-14T17:06:58.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = db975ff8-becf-49d7-a34a-876d7d1b2aed resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69872024-11-14T17:06:58.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = db975ff8-becf-49d7-a34a-876d7d1b2aed response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69882024-11-14T17:06:59.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ca48b9d5-8f06-4689-8199-70f692eee000 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69892024-11-14T17:06:59.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ca48b9d5-8f06-4689-8199-70f692eee000 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69902024-11-14T17:06:59.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ca48b9d5-8f06-4689-8199-70f692eee000 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69912024-11-14T17:07:00.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3158d469-6cab-42db-82bf-d8161876c21c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69922024-11-14T17:07:00.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3158d469-6cab-42db-82bf-d8161876c21c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69932024-11-14T17:07:00.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3158d469-6cab-42db-82bf-d8161876c21c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69942024-11-14T17:07:01.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 47fb0727-036f-45a6-b497-7e87488070ca roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69952024-11-14T17:07:01.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 47fb0727-036f-45a6-b497-7e87488070ca resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69962024-11-14T17:07:01.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 47fb0727-036f-45a6-b497-7e87488070ca response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
69972024-11-14T17:07:02.188ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:42243
69982024-11-14T17:07:02.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42243 req_id = ca6009e0-2a12-42f1-b3b1-f26e2ee8cd22 roles = RoleSet { roles: {} } uri = /metrics/producers
69992024-11-14T17:07:02.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42243 req_id = ca6009e0-2a12-42f1-b3b1-f26e2ee8cd22 resource = Database result = Ok(()) uri = /metrics/producers
70002024-11-14T17:07:02.196ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
70012024-11-14T17:07:02.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7125 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42243 req_id = ca6009e0-2a12-42f1-b3b1-f26e2ee8cd22 response_code = 201 uri = /metrics/producers
70022024-11-14T17:07:02.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b5d2c84e-64bd-4d7f-976e-766b3feddc07 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70032024-11-14T17:07:02.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b5d2c84e-64bd-4d7f-976e-766b3feddc07 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70042024-11-14T17:07:02.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b5d2c84e-64bd-4d7f-976e-766b3feddc07 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70052024-11-14T17:07:02.908ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:58569
70062024-11-14T17:07:02.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58569 req_id = b83a8e03-7590-45a9-ad55-4de1d46ac77f roles = RoleSet { roles: {} } uri = /metrics/producers
70072024-11-14T17:07:02.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58569 req_id = b83a8e03-7590-45a9-ad55-4de1d46ac77f resource = Database result = Ok(()) uri = /metrics/producers
70082024-11-14T17:07:02.917ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = 96e8c35c-9335-4348-babf-c56b7d06c593
70092024-11-14T17:07:02.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9008 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58569 req_id = b83a8e03-7590-45a9-ad55-4de1d46ac77f response_code = 201 uri = /metrics/producers
70102024-11-14T17:07:03.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9dba92cf-6f0e-4cb0-b3bd-eecfb2571b9a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70112024-11-14T17:07:03.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9dba92cf-6f0e-4cb0-b3bd-eecfb2571b9a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70122024-11-14T17:07:03.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9dba92cf-6f0e-4cb0-b3bd-eecfb2571b9a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70132024-11-14T17:07:03.561ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:64980
70142024-11-14T17:07:03.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64980 req_id = b33837f1-ea11-4949-a5b9-3ec997d48212 roles = RoleSet { roles: {} } uri = /metrics/producers
70152024-11-14T17:07:03.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64980 req_id = b33837f1-ea11-4949-a5b9-3ec997d48212 resource = Database result = Ok(()) uri = /metrics/producers
70162024-11-14T17:07:03.597ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = 973cae68-7270-4bdc-af1f-f9462c2eb9cf
70172024-11-14T17:07:03.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36002 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64980 req_id = b33837f1-ea11-4949-a5b9-3ec997d48212 response_code = 201 uri = /metrics/producers
70182024-11-14T17:07:03.655ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:64667
70192024-11-14T17:07:03.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64667 req_id = 7454a439-f04d-4956-b89b-b30f7d879664 roles = RoleSet { roles: {} } uri = /metrics/producers
70202024-11-14T17:07:03.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64667 req_id = 7454a439-f04d-4956-b89b-b30f7d879664 resource = Database result = Ok(()) uri = /metrics/producers
70212024-11-14T17:07:03.663ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = cd3068aa-0bb3-4c89-8df3-40f9024907ef
70222024-11-14T17:07:03.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7812 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64667 req_id = 7454a439-f04d-4956-b89b-b30f7d879664 response_code = 201 uri = /metrics/producers
70232024-11-14T17:07:04.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b8b266ca-8c31-4482-a465-7b5ebf1d955b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70242024-11-14T17:07:04.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b8b266ca-8c31-4482-a465-7b5ebf1d955b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70252024-11-14T17:07:04.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b8b266ca-8c31-4482-a465-7b5ebf1d955b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70262024-11-14T17:07:05.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bafa10ab-f33b-491b-a99c-a9c17b58628a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70272024-11-14T17:07:05.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bafa10ab-f33b-491b-a99c-a9c17b58628a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70282024-11-14T17:07:05.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bafa10ab-f33b-491b-a99c-a9c17b58628a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70292024-11-14T17:07:06.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = efbadd1a-9e29-43e8-ae85-fee888dc9299 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70302024-11-14T17:07:06.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = efbadd1a-9e29-43e8-ae85-fee888dc9299 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70312024-11-14T17:07:06.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = efbadd1a-9e29-43e8-ae85-fee888dc9299 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70322024-11-14T17:07:06.709ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
70332024-11-14T17:07:06.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70342024-11-14T17:07:06.709ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
70352024-11-14T17:07:06.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70362024-11-14T17:07:06.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70372024-11-14T17:07:06.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70382024-11-14T17:07:06.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70392024-11-14T17:07:06.712ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70402024-11-14T17:07:06.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70412024-11-14T17:07:06.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70422024-11-14T17:07:06.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70432024-11-14T17:07:06.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70442024-11-14T17:07:06.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70452024-11-14T17:07:06.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70462024-11-14T17:07:06.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70472024-11-14T17:07:06.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
70482024-11-14T17:07:06.721ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70492024-11-14T17:07:06.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70502024-11-14T17:07:06.733ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
70512024-11-14T17:07:06.733ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.301588ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
70522024-11-14T17:07:06.742ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.365581ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70532024-11-14T17:07:07.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 44a31e2b-bca8-4a96-af30-5602d175a19c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70542024-11-14T17:07:07.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 44a31e2b-bca8-4a96-af30-5602d175a19c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70552024-11-14T17:07:07.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 44a31e2b-bca8-4a96-af30-5602d175a19c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70562024-11-14T17:07:08.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5c8e6406-a172-4491-a621-90abcbc09102 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70572024-11-14T17:07:08.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5c8e6406-a172-4491-a621-90abcbc09102 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70582024-11-14T17:07:08.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 5c8e6406-a172-4491-a621-90abcbc09102 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70592024-11-14T17:07:08.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 78f79e17-866a-435c-b809-4702dd3ae839 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
70602024-11-14T17:07:08.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 78f79e17-866a-435c-b809-4702dd3ae839 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
70612024-11-14T17:07:08.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3075 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 78f79e17-866a-435c-b809-4702dd3ae839 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
70622024-11-14T17:07:09.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 30a5243f-731a-4e30-80b0-f9fcb86e5625 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70632024-11-14T17:07:09.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 30a5243f-731a-4e30-80b0-f9fcb86e5625 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70642024-11-14T17:07:09.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2893 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 30a5243f-731a-4e30-80b0-f9fcb86e5625 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70652024-11-14T17:07:10.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0a134276-fe0e-499f-ab8e-c74900ecafeb roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70662024-11-14T17:07:10.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0a134276-fe0e-499f-ab8e-c74900ecafeb resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70672024-11-14T17:07:10.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0a134276-fe0e-499f-ab8e-c74900ecafeb response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70682024-11-14T17:07:11.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9bc0877b-7c7b-42ed-a41f-97907031c5da roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70692024-11-14T17:07:11.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9bc0877b-7c7b-42ed-a41f-97907031c5da resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70702024-11-14T17:07:11.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9bc0877b-7c7b-42ed-a41f-97907031c5da response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70712024-11-14T17:07:11.607ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1395 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 30ba0e90-1789-4db5-8736-1975c8cfadac response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
70722024-11-14T17:07:12.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a9d67340-bb7a-4ece-9403-f0c91ff4ab73 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70732024-11-14T17:07:12.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a9d67340-bb7a-4ece-9403-f0c91ff4ab73 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70742024-11-14T17:07:12.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a9d67340-bb7a-4ece-9403-f0c91ff4ab73 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70752024-11-14T17:07:13.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9b63a8d3-6f83-42c9-9709-5f0dd83f582c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70762024-11-14T17:07:13.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9b63a8d3-6f83-42c9-9709-5f0dd83f582c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70772024-11-14T17:07:13.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9b63a8d3-6f83-42c9-9709-5f0dd83f582c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70782024-11-14T17:07:14.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f03c9c90-7c41-4b45-b902-4df5cd224777 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70792024-11-14T17:07:14.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f03c9c90-7c41-4b45-b902-4df5cd224777 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70802024-11-14T17:07:14.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f03c9c90-7c41-4b45-b902-4df5cd224777 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70812024-11-14T17:07:15.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0b3732ec-2c81-46eb-9dcf-4d9c18eb9d00 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70822024-11-14T17:07:15.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0b3732ec-2c81-46eb-9dcf-4d9c18eb9d00 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70832024-11-14T17:07:15.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0b3732ec-2c81-46eb-9dcf-4d9c18eb9d00 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70842024-11-14T17:07:16.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3d735765-10d9-4eb4-bea4-1c52bb386026 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70852024-11-14T17:07:16.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3d735765-10d9-4eb4-bea4-1c52bb386026 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70862024-11-14T17:07:16.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3d735765-10d9-4eb4-bea4-1c52bb386026 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
70872024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
70882024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
70892024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70902024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
70912024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70922024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
70932024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
70942024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70952024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
70962024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70972024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
70982024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
70992024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71002024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71012024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
71022024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71032024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
71042024-11-14T17:07:16.710ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5
71052024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
71062024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.101\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5"}
71072024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71082024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
71092024-11-14T17:07:16.710ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
71102024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
71112024-11-14T17:07:16.710ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 16:57:16.710438779 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
71122024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71132024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
71142024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
71152024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71162024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
71172024-11-14T17:07:16.710ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
71182024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71192024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
71202024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71212024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
71222024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
71232024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
71242024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71252024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71262024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71272024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
71282024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71292024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
71302024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
71312024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
71322024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71332024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
71342024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
71352024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
71362024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
71372024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
71382024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71392024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
71402024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
71412024-11-14T17:07:16.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
71422024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
71432024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
71442024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71452024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
71462024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
71472024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
71482024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
71492024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71502024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71512024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71522024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71532024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71542024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71552024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71562024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
71572024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71582024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71592024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71602024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71612024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71622024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71632024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
71642024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
71652024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71662024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
71672024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
71682024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71692024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71702024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71712024-11-14T17:07:16.711ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94482e71-9503-4d09-b73f-615fbf343a2e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2560, tv_nsec: 440072910 } })
71722024-11-14T17:07:16.711ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89b01be2-c37f-445d-addd-6b4be9cd73c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc5fdca1-6d92-4ff4-b5ae-2f44553a2186.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2560, tv_nsec: 440083490 } })
71732024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71742024-11-14T17:07:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71752024-11-14T17:07:16.712ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
71762024-11-14T17:07:16.712ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.500814ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
71772024-11-14T17:07:16.712ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
71782024-11-14T17:07:16.712ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.700739ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
71792024-11-14T17:07:16.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71802024-11-14T17:07:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71812024-11-14T17:07:16.714ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71822024-11-14T17:07:16.714ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2560, tv_nsec: 443343273 } })
71832024-11-14T17:07:16.715ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.387489ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71842024-11-14T17:07:16.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71852024-11-14T17:07:16.715ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
71862024-11-14T17:07:16.716ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71872024-11-14T17:07:16.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71882024-11-14T17:07:16.717ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71892024-11-14T17:07:16.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71902024-11-14T17:07:16.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
71912024-11-14T17:07:16.718ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71922024-11-14T17:07:16.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71932024-11-14T17:07:16.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
71942024-11-14T17:07:16.719ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71952024-11-14T17:07:16.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71962024-11-14T17:07:16.722ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71972024-11-14T17:07:16.724ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2560, tv_nsec: 452998731 } })
71982024-11-14T17:07:16.725ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
71992024-11-14T17:07:16.725ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 16:57:16.710438779 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
72002024-11-14T17:07:16.725ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.956047ms iteration = 14 status = {"expiration":"2024-11-14T16:57:16.710438779Z","pruned":[]}
72012024-11-14T17:07:16.726ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72022024-11-14T17:07:16.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72032024-11-14T17:07:16.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72042024-11-14T17:07:16.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72052024-11-14T17:07:16.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72062024-11-14T17:07:16.728ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72072024-11-14T17:07:16.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72082024-11-14T17:07:16.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 18.141669ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
72092024-11-14T17:07:16.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72102024-11-14T17:07:16.731ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.653766ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
72112024-11-14T17:07:16.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72122024-11-14T17:07:16.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72132024-11-14T17:07:16.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72142024-11-14T17:07:16.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72152024-11-14T17:07:16.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72162024-11-14T17:07:16.737ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
72172024-11-14T17:07:16.737ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
72182024-11-14T17:07:16.737ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 26.352905ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
72192024-11-14T17:07:16.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72202024-11-14T17:07:16.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72212024-11-14T17:07:16.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72222024-11-14T17:07:16.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72232024-11-14T17:07:16.741ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2560, tv_nsec: 469941333 } })
72242024-11-14T17:07:16.741ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
72252024-11-14T17:07:16.742ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72262024-11-14T17:07:16.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72272024-11-14T17:07:16.743ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72282024-11-14T17:07:16.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72292024-11-14T17:07:16.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72302024-11-14T17:07:16.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72312024-11-14T17:07:16.744ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72322024-11-14T17:07:16.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72332024-11-14T17:07:16.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72342024-11-14T17:07:16.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
72352024-11-14T17:07:16.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72362024-11-14T17:07:16.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72372024-11-14T17:07:16.754ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72382024-11-14T17:07:16.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72392024-11-14T17:07:16.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72402024-11-14T17:07:16.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72412024-11-14T17:07:16.768ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72422024-11-14T17:07:16.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72432024-11-14T17:07:16.783ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72442024-11-14T17:07:16.785ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72452024-11-14T17:07:16.785ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
72462024-11-14T17:07:16.785ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72472024-11-14T17:07:16.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72482024-11-14T17:07:16.787ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72492024-11-14T17:07:16.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72502024-11-14T17:07:16.788ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72512024-11-14T17:07:16.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72522024-11-14T17:07:16.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72532024-11-14T17:07:16.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72542024-11-14T17:07:16.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72552024-11-14T17:07:16.795ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
72562024-11-14T17:07:16.795ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.631069ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
72572024-11-14T17:07:16.795ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 85.031809ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
72582024-11-14T17:07:16.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72592024-11-14T17:07:16.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72602024-11-14T17:07:16.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72612024-11-14T17:07:16.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72622024-11-14T17:07:16.801ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
72632024-11-14T17:07:16.801ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
72642024-11-14T17:07:16.801ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 90.668196ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
72652024-11-14T17:07:16.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72662024-11-14T17:07:16.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72672024-11-14T17:07:16.813ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72682024-11-14T17:07:16.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72692024-11-14T17:07:16.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72702024-11-14T17:07:16.816ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72712024-11-14T17:07:16.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72722024-11-14T17:07:16.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72732024-11-14T17:07:16.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72742024-11-14T17:07:16.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72752024-11-14T17:07:16.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
72762024-11-14T17:07:16.816ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72772024-11-14T17:07:16.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72782024-11-14T17:07:16.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72792024-11-14T17:07:16.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72802024-11-14T17:07:16.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
72812024-11-14T17:07:16.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72822024-11-14T17:07:16.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72832024-11-14T17:07:16.825ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 115.086967ms iteration = 27 status = 0
72842024-11-14T17:07:16.832ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
72852024-11-14T17:07:16.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
72862024-11-14T17:07:16.835ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72872024-11-14T17:07:16.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72882024-11-14T17:07:16.851ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72892024-11-14T17:07:16.851ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
72902024-11-14T17:07:16.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72912024-11-14T17:07:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72922024-11-14T17:07:16.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 143.751424ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72932024-11-14T17:07:16.857ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
72942024-11-14T17:07:16.857ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
72952024-11-14T17:07:16.857ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
72962024-11-14T17:07:16.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72972024-11-14T17:07:16.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72982024-11-14T17:07:16.858ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
72992024-11-14T17:07:16.858ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 147.642311ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
73002024-11-14T17:07:16.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73012024-11-14T17:07:16.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 150.954156ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73022024-11-14T17:07:16.862ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
73032024-11-14T17:07:16.862ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
73042024-11-14T17:07:16.862ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
73052024-11-14T17:07:16.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73062024-11-14T17:07:16.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73072024-11-14T17:07:16.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73082024-11-14T17:07:16.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73092024-11-14T17:07:16.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73102024-11-14T17:07:16.867ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73112024-11-14T17:07:16.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73122024-11-14T17:07:16.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73132024-11-14T17:07:16.871ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 160.235385ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
73142024-11-14T17:07:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73152024-11-14T17:07:16.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73162024-11-14T17:07:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73172024-11-14T17:07:16.888ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
73182024-11-14T17:07:16.888ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73192024-11-14T17:07:16.888ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac65c786-7479-4cbc-8d18-2775483768bd", "content-length": "26", "date": "Thu, 14 Nov 2024 17:07:16 GMT"} })
73202024-11-14T17:07:16.888ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73212024-11-14T17:07:16.891ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73222024-11-14T17:07:16.892ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
73232024-11-14T17:07:16.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 208.147776ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
73242024-11-14T17:07:16.924ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
73252024-11-14T17:07:16.932ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73262024-11-14T17:07:16.932ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
73272024-11-14T17:07:16.932ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 222.05481ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
73282024-11-14T17:07:16.935ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
73292024-11-14T17:07:16.935ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 0 version = 2
73302024-11-14T17:07:16.935ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73312024-11-14T17:07:16.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73322024-11-14T17:07:16.939ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
73332024-11-14T17:07:16.939ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
73342024-11-14T17:07:16.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73352024-11-14T17:07:16.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73362024-11-14T17:07:16.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73372024-11-14T17:07:16.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73382024-11-14T17:07:16.943ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73392024-11-14T17:07:16.943ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73402024-11-14T17:07:16.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73412024-11-14T17:07:16.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73422024-11-14T17:07:16.945ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73432024-11-14T17:07:16.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73442024-11-14T17:07:16.947ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
73452024-11-14T17:07:16.947ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73462024-11-14T17:07:16.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73472024-11-14T17:07:16.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73482024-11-14T17:07:16.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73492024-11-14T17:07:16.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73502024-11-14T17:07:16.965ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
73512024-11-14T17:07:16.965ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73522024-11-14T17:07:16.966ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8d75b80-54a2-4894-a5d8-7016e59c615c", "content-length": "26", "date": "Thu, 14 Nov 2024 17:07:16 GMT"} })
73532024-11-14T17:07:16.966ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73542024-11-14T17:07:16.967ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
73552024-11-14T17:07:16.968ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 258.029301ms iteration = 31 status = {"physical_disks_added":0}
73562024-11-14T17:07:16.975ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
73572024-11-14T17:07:16.975ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 265.49708ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
73582024-11-14T17:07:17.012ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
73592024-11-14T17:07:17.012ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73602024-11-14T17:07:17.013ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88524a13-4f37-42f0-a890-79648df2f2f0", "content-length": "26", "date": "Thu, 14 Nov 2024 17:07:16 GMT"} })
73612024-11-14T17:07:17.013ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73622024-11-14T17:07:17.015ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73632024-11-14T17:07:17.037ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
73642024-11-14T17:07:17.038ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4552dd77-7f30-4ca8-949b-a71225cbc644", "content-length": "2", "date": "Thu, 14 Nov 2024 17:07:16 GMT"} })
73652024-11-14T17:07:17.040ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73662024-11-14T17:07:17.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73672024-11-14T17:07:17.070ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
73682024-11-14T17:07:17.084ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
73692024-11-14T17:07:17.084ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73702024-11-14T17:07:17.084ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "115b352a-03a4-44c4-9d8c-417a8f1a9263", "content-length": "372", "date": "Thu, 14 Nov 2024 17:07:17 GMT"} })
73712024-11-14T17:07:17.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73722024-11-14T17:07:17.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73732024-11-14T17:07:17.087ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 1 version = 2
73742024-11-14T17:07:17.087ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
73752024-11-14T17:07:17.087ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 16:54:47.468912 UTC dns_group = external generation = 2
73762024-11-14T17:07:17.087ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 376.764301ms iteration = 15 status = {"generation":2}
73772024-11-14T17:07:17.088ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 377.777443ms iteration = 27 status = null
73782024-11-14T17:07:17.088ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
73792024-11-14T17:07:17.088ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
73802024-11-14T17:07:17.088ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 16:54:46.198050 UTC dns_group = internal generation = 1
73812024-11-14T17:07:17.088ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 378.577732ms iteration = 15 status = {"generation":1}
73822024-11-14T17:07:17.100ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
73832024-11-14T17:07:17.100ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
73842024-11-14T17:07:17.100ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "151b2205-820d-45a6-8fbe-6a76198da887", "date": "Thu, 14 Nov 2024 17:07:17 GMT"} })
73852024-11-14T17:07:17.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73862024-11-14T17:07:17.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73872024-11-14T17:07:17.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73882024-11-14T17:07:17.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73892024-11-14T17:07:17.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73902024-11-14T17:07:17.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73912024-11-14T17:07:17.108ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
73922024-11-14T17:07:17.108ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2ce33e7c-bddd-479a-b1df-4911dd423eb9", "date": "Thu, 14 Nov 2024 17:07:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73932024-11-14T17:07:17.108ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73942024-11-14T17:07:17.109ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
73952024-11-14T17:07:17.109ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73962024-11-14T17:07:17.109ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "078313e6-f4d4-4b62-a987-518431fa3b3d", "date": "Thu, 14 Nov 2024 17:07:17 GMT"} })
73972024-11-14T17:07:17.110ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "97c44a33-dc2c-495b-83f4-33b34525c94e", "date": "Thu, 14 Nov 2024 17:07:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73982024-11-14T17:07:17.110ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73992024-11-14T17:07:17.112ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 402.303047ms iteration = 29 status = {}
74002024-11-14T17:07:17.113ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
74012024-11-14T17:07:17.113ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 403.091365ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
74022024-11-14T17:07:17.134ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T16:54:14.392760Z, time_modified: 2024-11-14T16:54:14.392760Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }) }
74032024-11-14T17:07:17.134ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 423.785561ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]}},"default_endpoint":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
74042024-11-14T17:07:17.135ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 425.259335ms iteration = 27 status = {}
74052024-11-14T17:07:17.157ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
74062024-11-14T17:07:17.158ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b6e49f98-deab-4914-b0e6-af881781f6e7", "date": "Thu, 14 Nov 2024 17:07:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
74072024-11-14T17:07:17.158ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
74082024-11-14T17:07:17.159ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3bd47937-6038-449b-a977-26941632f57b", "date": "Thu, 14 Nov 2024 17:07:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
74092024-11-14T17:07:17.159ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
74102024-11-14T17:07:17.163ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ffce8a9d-60da-4a0c-97eb-6e99f2e787e4", "date": "Thu, 14 Nov 2024 17:07:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
74112024-11-14T17:07:17.163ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
74122024-11-14T17:07:17.165ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
74132024-11-14T17:07:17.165ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 455.103799ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
74142024-11-14T17:07:17.200ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74152024-11-14T17:07:17.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74162024-11-14T17:07:17.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74172024-11-14T17:07:17.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74182024-11-14T17:07:17.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74192024-11-14T17:07:17.203ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74202024-11-14T17:07:17.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74212024-11-14T17:07:17.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74222024-11-14T17:07:17.203ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
74232024-11-14T17:07:17.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74242024-11-14T17:07:17.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74252024-11-14T17:07:17.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74262024-11-14T17:07:17.208ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74272024-11-14T17:07:17.208ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74282024-11-14T17:07:17.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74292024-11-14T17:07:17.213ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
74302024-11-14T17:07:17.213ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ade21fd-647e-4cdf-99b2-711e7c2e46a6", "content-length": "134", "date": "Thu, 14 Nov 2024 17:07:16 GMT"} })
74312024-11-14T17:07:17.213ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
74322024-11-14T17:07:17.213ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
74332024-11-14T17:07:17.214ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
74342024-11-14T17:07:17.214ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
74352024-11-14T17:07:17.214ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74362024-11-14T17:07:17.214ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74372024-11-14T17:07:17.214ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74382024-11-14T17:07:17.214ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74392024-11-14T17:07:17.214ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74402024-11-14T17:07:17.214ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74412024-11-14T17:07:17.214ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
74422024-11-14T17:07:17.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74432024-11-14T17:07:17.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74442024-11-14T17:07:17.216ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
74452024-11-14T17:07:17.216ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d45de1b-6573-494e-82ca-21765b751df2", "content-length": "2", "date": "Thu, 14 Nov 2024 17:07:16 GMT"} })
74462024-11-14T17:07:17.216ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
74472024-11-14T17:07:17.216ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a6163f1-65d1-4292-94b7-d21dcb5eceb8", "content-length": "52", "date": "Thu, 14 Nov 2024 17:07:16 GMT"} })
74482024-11-14T17:07:17.216ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
74492024-11-14T17:07:17.216ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
74502024-11-14T17:07:17.247ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
74512024-11-14T17:07:17.332ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7614e7fe-91e2-4b6f-a899-06eed1d273a9", "date": "Thu, 14 Nov 2024 17:07:17 GMT"} })
74522024-11-14T17:07:17.332ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
74532024-11-14T17:07:17.332ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
74542024-11-14T17:07:17.333ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "147b9d19-2dab-4ba0-8620-2fbd18eab960", "content-length": "682", "date": "Thu, 14 Nov 2024 17:07:17 GMT"} })
74552024-11-14T17:07:17.333ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ac0f617-f5ec-42e5-a60f-c8cf7e73acc6", "content-length": "691", "date": "Thu, 14 Nov 2024 17:07:17 GMT"} })
74562024-11-14T17:07:17.333ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
74572024-11-14T17:07:17.333ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
74582024-11-14T17:07:17.333ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
74592024-11-14T17:07:17.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74602024-11-14T17:07:17.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74612024-11-14T17:07:17.334ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 624.157362ms iteration = 28 status = {}
74622024-11-14T17:07:17.337ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74632024-11-14T17:07:17.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74642024-11-14T17:07:17.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74652024-11-14T17:07:17.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74662024-11-14T17:07:17.344ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74672024-11-14T17:07:17.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74682024-11-14T17:07:17.351ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 641.485784ms iteration = 27 status = {}
74692024-11-14T17:07:17.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 90c0f8c8-c3f2-4355-9ba2-e259fd549a31 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74702024-11-14T17:07:17.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 90c0f8c8-c3f2-4355-9ba2-e259fd549a31 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74712024-11-14T17:07:17.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 90c0f8c8-c3f2-4355-9ba2-e259fd549a31 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74722024-11-14T17:07:18.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 478425ac-2aa2-45d1-94a1-81ab0f274df7 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74732024-11-14T17:07:18.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 478425ac-2aa2-45d1-94a1-81ab0f274df7 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74742024-11-14T17:07:18.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1795 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 478425ac-2aa2-45d1-94a1-81ab0f274df7 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74752024-11-14T17:07:18.921ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
74762024-11-14T17:07:18.921ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
74772024-11-14T17:07:18.952ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
74782024-11-14T17:07:18.952ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:35471
74792024-11-14T17:07:18.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:35471 req_id = 7e6b19c5-4129-43df-a0ac-fe80795ae44c roles = RoleSet { roles: {} } uri = /metrics/producers
74802024-11-14T17:07:18.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:35471 req_id = 7e6b19c5-4129-43df-a0ac-fe80795ae44c resource = Database result = Ok(()) uri = /metrics/producers
74812024-11-14T17:07:18.996ZINFOnexus: assigned collector to new producer collector_id = eb1db522-cd7d-4b64-9412-796885aef8d2 file = nexus/src/app/oximeter.rs:76 producer_id = 0cc022d1-76d3-4a28-8e75-e8e958faa197
74822024-11-14T17:07:18.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43820 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:35471 req_id = 7e6b19c5-4129-43df-a0ac-fe80795ae44c response_code = 201 uri = /metrics/producers
74832024-11-14T17:07:18.996ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "7e6b19c5-4129-43df-a0ac-fe80795ae44c", "content-length": "41", "date": "Thu, 14 Nov 2024 17:07:18 GMT"} })
74842024-11-14T17:07:18.997ZDEBGnexus (producer-registration-task): registered with nexus successfully
74852024-11-14T17:07:18.997ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
74862024-11-14T17:07:19.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 762a0914-8a31-4316-a2b0-92cb1d920281 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74872024-11-14T17:07:19.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 762a0914-8a31-4316-a2b0-92cb1d920281 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74882024-11-14T17:07:19.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 762a0914-8a31-4316-a2b0-92cb1d920281 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74892024-11-14T17:07:20.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = eebfa07b-39bb-4fca-9a54-b50bb657b25a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74902024-11-14T17:07:20.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = eebfa07b-39bb-4fca-9a54-b50bb657b25a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74912024-11-14T17:07:20.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = eebfa07b-39bb-4fca-9a54-b50bb657b25a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74922024-11-14T17:07:21.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1f866019-1833-4161-83fe-e0f97fde80e0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74932024-11-14T17:07:21.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1f866019-1833-4161-83fe-e0f97fde80e0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74942024-11-14T17:07:21.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1f866019-1833-4161-83fe-e0f97fde80e0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74952024-11-14T17:07:22.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 21bee752-13d7-454b-b27a-1bc4c0236909 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74962024-11-14T17:07:22.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 21bee752-13d7-454b-b27a-1bc4c0236909 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74972024-11-14T17:07:22.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 21bee752-13d7-454b-b27a-1bc4c0236909 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74982024-11-14T17:07:23.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9f09a1e1-0fde-472c-996a-a3af66e94408 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
74992024-11-14T17:07:23.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9f09a1e1-0fde-472c-996a-a3af66e94408 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75002024-11-14T17:07:23.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9f09a1e1-0fde-472c-996a-a3af66e94408 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75012024-11-14T17:07:24.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0de22e3b-2b99-40ed-8b4f-a0b66b8556d7 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75022024-11-14T17:07:24.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0de22e3b-2b99-40ed-8b4f-a0b66b8556d7 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75032024-11-14T17:07:24.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0de22e3b-2b99-40ed-8b4f-a0b66b8556d7 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75042024-11-14T17:07:25.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f73ab7ae-a800-4378-8f1f-7588352023d7 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75052024-11-14T17:07:25.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f73ab7ae-a800-4378-8f1f-7588352023d7 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75062024-11-14T17:07:25.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2004 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f73ab7ae-a800-4378-8f1f-7588352023d7 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75072024-11-14T17:07:26.607ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1356 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = cd6c4c74-a43e-4646-87be-1215a3414522 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
75082024-11-14T17:07:26.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
75092024-11-14T17:07:26.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
75102024-11-14T17:07:26.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75112024-11-14T17:07:26.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75122024-11-14T17:07:26.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75132024-11-14T17:07:26.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75142024-11-14T17:07:26.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75152024-11-14T17:07:26.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75162024-11-14T17:07:26.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75172024-11-14T17:07:26.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75182024-11-14T17:07:26.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75192024-11-14T17:07:26.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75202024-11-14T17:07:26.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75212024-11-14T17:07:26.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
75222024-11-14T17:07:26.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75232024-11-14T17:07:26.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75242024-11-14T17:07:26.733ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
75252024-11-14T17:07:26.733ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.243945ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
75262024-11-14T17:07:26.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75272024-11-14T17:07:26.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75282024-11-14T17:07:26.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.007111ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75292024-11-14T17:07:26.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d29bd6d9-d413-44f5-86b3-f2973ce478ab roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75302024-11-14T17:07:26.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d29bd6d9-d413-44f5-86b3-f2973ce478ab resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75312024-11-14T17:07:26.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d29bd6d9-d413-44f5-86b3-f2973ce478ab response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75322024-11-14T17:07:27.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d4bf7e0d-0dfe-42fa-b63a-ffe8aa976c55 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75332024-11-14T17:07:27.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d4bf7e0d-0dfe-42fa-b63a-ffe8aa976c55 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75342024-11-14T17:07:27.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d4bf7e0d-0dfe-42fa-b63a-ffe8aa976c55 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75352024-11-14T17:07:28.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e7533059-27ea-4555-89cb-e03b3dddd60d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75362024-11-14T17:07:28.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e7533059-27ea-4555-89cb-e03b3dddd60d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75372024-11-14T17:07:28.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e7533059-27ea-4555-89cb-e03b3dddd60d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75382024-11-14T17:07:29.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7d0183b2-66df-41d4-bb69-5b5100d71dad roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75392024-11-14T17:07:29.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7d0183b2-66df-41d4-bb69-5b5100d71dad resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75402024-11-14T17:07:29.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 7d0183b2-66df-41d4-bb69-5b5100d71dad response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75412024-11-14T17:07:30.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = aec283b3-8f98-41bb-ac60-81d2ed211907 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75422024-11-14T17:07:30.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = aec283b3-8f98-41bb-ac60-81d2ed211907 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75432024-11-14T17:07:30.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = aec283b3-8f98-41bb-ac60-81d2ed211907 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75442024-11-14T17:07:31.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 8bcb25e9-b53e-419e-8cf6-422b048062cb roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
75452024-11-14T17:07:31.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 8bcb25e9-b53e-419e-8cf6-422b048062cb resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
75462024-11-14T17:07:31.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 8bcb25e9-b53e-419e-8cf6-422b048062cb response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
75472024-11-14T17:07:31.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = c1bb2d86-06ef-4b38-a13b-1433189988fc roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
75482024-11-14T17:07:31.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = c1bb2d86-06ef-4b38-a13b-1433189988fc resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
75492024-11-14T17:07:31.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = c1bb2d86-06ef-4b38-a13b-1433189988fc response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
75502024-11-14T17:07:31.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f3f9a8e5-d8fc-4df1-bc62-98ea1e5b73e3 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75512024-11-14T17:07:31.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f3f9a8e5-d8fc-4df1-bc62-98ea1e5b73e3 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75522024-11-14T17:07:31.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = f3f9a8e5-d8fc-4df1-bc62-98ea1e5b73e3 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75532024-11-14T17:07:32.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 817f549b-66c2-4923-9557-7a999df79532 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75542024-11-14T17:07:32.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 817f549b-66c2-4923-9557-7a999df79532 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75552024-11-14T17:07:32.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 817f549b-66c2-4923-9557-7a999df79532 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75562024-11-14T17:07:33.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 41700939-e8c3-41ca-8ede-e6c9c3999b25 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75572024-11-14T17:07:33.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 41700939-e8c3-41ca-8ede-e6c9c3999b25 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75582024-11-14T17:07:33.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 41700939-e8c3-41ca-8ede-e6c9c3999b25 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75592024-11-14T17:07:35.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cc61d904-7340-4070-a6f2-1f2be4f59dd3 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75602024-11-14T17:07:35.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cc61d904-7340-4070-a6f2-1f2be4f59dd3 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75612024-11-14T17:07:35.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cc61d904-7340-4070-a6f2-1f2be4f59dd3 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75622024-11-14T17:07:36.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 84f2d638-1a37-444f-98ed-7a13c7f8356b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75632024-11-14T17:07:36.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 84f2d638-1a37-444f-98ed-7a13c7f8356b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75642024-11-14T17:07:36.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 84f2d638-1a37-444f-98ed-7a13c7f8356b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75652024-11-14T17:07:36.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
75662024-11-14T17:07:36.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
75672024-11-14T17:07:36.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75682024-11-14T17:07:36.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75692024-11-14T17:07:36.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75702024-11-14T17:07:36.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75712024-11-14T17:07:36.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75722024-11-14T17:07:36.713ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75732024-11-14T17:07:36.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75742024-11-14T17:07:36.715ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.839639ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75752024-11-14T17:07:36.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75762024-11-14T17:07:36.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75772024-11-14T17:07:36.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75782024-11-14T17:07:36.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75792024-11-14T17:07:36.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75802024-11-14T17:07:36.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75812024-11-14T17:07:36.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
75822024-11-14T17:07:36.721ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75832024-11-14T17:07:36.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75842024-11-14T17:07:36.729ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
75852024-11-14T17:07:36.729ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.610079ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
75862024-11-14T17:07:37.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 75404318-f24b-4f89-9bd3-1cb746cac891 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75872024-11-14T17:07:37.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 75404318-f24b-4f89-9bd3-1cb746cac891 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75882024-11-14T17:07:37.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 75404318-f24b-4f89-9bd3-1cb746cac891 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75892024-11-14T17:07:38.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c9529c83-da13-422e-8551-70ba9c01a479 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75902024-11-14T17:07:38.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c9529c83-da13-422e-8551-70ba9c01a479 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75912024-11-14T17:07:38.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c9529c83-da13-422e-8551-70ba9c01a479 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75922024-11-14T17:07:38.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 4441cbb7-55e1-42cf-8355-ebe96924f199 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
75932024-11-14T17:07:38.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 4441cbb7-55e1-42cf-8355-ebe96924f199 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
75942024-11-14T17:07:38.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3709 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 4441cbb7-55e1-42cf-8355-ebe96924f199 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
75952024-11-14T17:07:39.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e9c01158-d7ae-47f5-a4d6-24c93e0b0c4d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75962024-11-14T17:07:39.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e9c01158-d7ae-47f5-a4d6-24c93e0b0c4d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75972024-11-14T17:07:39.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = e9c01158-d7ae-47f5-a4d6-24c93e0b0c4d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75982024-11-14T17:07:40.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 641a63cc-4389-40b5-8a6b-330c81eb625c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
75992024-11-14T17:07:40.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 641a63cc-4389-40b5-8a6b-330c81eb625c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76002024-11-14T17:07:40.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 641a63cc-4389-40b5-8a6b-330c81eb625c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76012024-11-14T17:07:41.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bb09ee65-d4d0-42b8-a76c-7e12e3423840 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76022024-11-14T17:07:41.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bb09ee65-d4d0-42b8-a76c-7e12e3423840 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76032024-11-14T17:07:41.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bb09ee65-d4d0-42b8-a76c-7e12e3423840 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76042024-11-14T17:07:41.607ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1351 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = f5b01b13-439a-4966-a92e-14b543dda865 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
76052024-11-14T17:07:42.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 408dc62e-2e7c-49c4-ad26-07ff92b3c8bb roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76062024-11-14T17:07:42.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 408dc62e-2e7c-49c4-ad26-07ff92b3c8bb resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76072024-11-14T17:07:42.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 408dc62e-2e7c-49c4-ad26-07ff92b3c8bb response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76082024-11-14T17:07:43.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 51e73519-d20f-410a-942c-b83cc52a4781 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76092024-11-14T17:07:43.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 51e73519-d20f-410a-942c-b83cc52a4781 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76102024-11-14T17:07:43.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 51e73519-d20f-410a-942c-b83cc52a4781 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76112024-11-14T17:07:44.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d9331842-79ce-4df0-b894-5d2abbdd8ac3 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76122024-11-14T17:07:44.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d9331842-79ce-4df0-b894-5d2abbdd8ac3 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76132024-11-14T17:07:44.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d9331842-79ce-4df0-b894-5d2abbdd8ac3 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76142024-11-14T17:07:45.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 42ba7511-3c43-4585-9322-2684b1401613 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76152024-11-14T17:07:45.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 42ba7511-3c43-4585-9322-2684b1401613 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76162024-11-14T17:07:45.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 42ba7511-3c43-4585-9322-2684b1401613 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76172024-11-14T17:07:46.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 560a56f2-288e-4acc-8547-ba960c1b3894 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76182024-11-14T17:07:46.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 560a56f2-288e-4acc-8547-ba960c1b3894 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76192024-11-14T17:07:46.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 560a56f2-288e-4acc-8547-ba960c1b3894 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
76202024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
76212024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
76222024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76232024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76242024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
76252024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
76262024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76272024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76282024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
76292024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
76302024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
76312024-11-14T17:07:46.710ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
76322024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76332024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
76342024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
76352024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76362024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76372024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
76382024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76392024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
76402024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
76412024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76422024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76432024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
76442024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
76452024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76462024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76472024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
76482024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
76492024-11-14T17:07:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76502024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
76512024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
76522024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76532024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
76542024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
76552024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76562024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76572024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76582024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76592024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
76602024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76612024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76622024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76632024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76642024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76652024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76662024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
76672024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
76682024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76692024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76702024-11-14T17:07:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76712024-11-14T17:07:46.713ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76722024-11-14T17:07:46.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76732024-11-14T17:07:46.714ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76742024-11-14T17:07:46.714ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76752024-11-14T17:07:46.715ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.293576ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
76762024-11-14T17:07:46.715ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2590, tv_nsec: 443430478 } })
76772024-11-14T17:07:46.715ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
76782024-11-14T17:07:46.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
76792024-11-14T17:07:46.717ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76802024-11-14T17:07:46.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76812024-11-14T17:07:46.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76822024-11-14T17:07:46.717ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76832024-11-14T17:07:46.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76842024-11-14T17:07:46.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76852024-11-14T17:07:46.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76862024-11-14T17:07:46.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76872024-11-14T17:07:46.718ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76882024-11-14T17:07:46.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76892024-11-14T17:07:46.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76902024-11-14T17:07:46.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76912024-11-14T17:07:46.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76922024-11-14T17:07:46.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76932024-11-14T17:07:46.723ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2590, tv_nsec: 451646563 } })
76942024-11-14T17:07:46.723ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
76952024-11-14T17:07:46.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76962024-11-14T17:07:46.725ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76972024-11-14T17:07:46.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76982024-11-14T17:07:46.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76992024-11-14T17:07:46.727ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77002024-11-14T17:07:46.727ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
77012024-11-14T17:07:46.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77022024-11-14T17:07:46.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
77032024-11-14T17:07:46.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77042024-11-14T17:07:46.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77052024-11-14T17:07:46.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77062024-11-14T17:07:46.728ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77072024-11-14T17:07:46.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77082024-11-14T17:07:46.731ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77092024-11-14T17:07:46.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77102024-11-14T17:07:46.731ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77112024-11-14T17:07:46.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77122024-11-14T17:07:46.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77132024-11-14T17:07:46.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77142024-11-14T17:07:46.732ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77152024-11-14T17:07:46.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77162024-11-14T17:07:46.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77172024-11-14T17:07:46.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77182024-11-14T17:07:46.738ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77192024-11-14T17:07:46.738ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2590, tv_nsec: 467130682 } })
77202024-11-14T17:07:46.739ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
77212024-11-14T17:07:46.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77222024-11-14T17:07:46.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77232024-11-14T17:07:46.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77242024-11-14T17:07:46.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.341654ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77252024-11-14T17:07:46.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.646981ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
77262024-11-14T17:07:46.785ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77272024-11-14T17:07:46.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77282024-11-14T17:07:46.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 74.829038ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
77292024-11-14T17:07:46.787ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 76.68224ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
77302024-11-14T17:07:46.795ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
77312024-11-14T17:07:46.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77322024-11-14T17:07:46.795ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.709941ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
77332024-11-14T17:07:46.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77342024-11-14T17:07:46.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77352024-11-14T17:07:46.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77362024-11-14T17:07:46.796ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77372024-11-14T17:07:46.797ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
77382024-11-14T17:07:46.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77392024-11-14T17:07:46.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77402024-11-14T17:07:46.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77412024-11-14T17:07:46.799ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77422024-11-14T17:07:46.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77432024-11-14T17:07:46.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
77442024-11-14T17:07:46.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77452024-11-14T17:07:46.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77462024-11-14T17:07:46.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.502785ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
77472024-11-14T17:07:46.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77482024-11-14T17:07:46.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77492024-11-14T17:07:46.812ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
77502024-11-14T17:07:46.812ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77512024-11-14T17:07:46.813ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e0f60cb-f544-405f-a7ea-cd9e88bce948", "content-length": "26", "date": "Thu, 14 Nov 2024 17:07:46 GMT"} })
77522024-11-14T17:07:46.813ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77532024-11-14T17:07:46.815ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77542024-11-14T17:07:46.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
77552024-11-14T17:07:46.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 111.388253ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
77562024-11-14T17:07:46.824ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
77572024-11-14T17:07:46.824ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77582024-11-14T17:07:46.824ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f08e714-7181-4ded-baa2-0aaf3d1f0f2d", "content-length": "26", "date": "Thu, 14 Nov 2024 17:07:46 GMT"} })
77592024-11-14T17:07:46.824ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77602024-11-14T17:07:46.826ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77612024-11-14T17:07:46.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.46589ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
77622024-11-14T17:07:46.835ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77632024-11-14T17:07:46.835ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77642024-11-14T17:07:46.835ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 124.718184ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
77652024-11-14T17:07:46.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77662024-11-14T17:07:46.841ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
77672024-11-14T17:07:46.841ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77682024-11-14T17:07:46.841ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e65675d4-60ed-42f5-bf41-1d41abd0fcd5", "content-length": "26", "date": "Thu, 14 Nov 2024 17:07:46 GMT"} })
77692024-11-14T17:07:46.841ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77702024-11-14T17:07:46.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
77712024-11-14T17:07:46.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77722024-11-14T17:07:46.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77732024-11-14T17:07:46.843ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
77742024-11-14T17:07:46.843ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 133.234046ms iteration = 28 status = 0
77752024-11-14T17:07:46.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77762024-11-14T17:07:46.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77772024-11-14T17:07:46.896ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 185.581797ms iteration = 32 status = {"physical_disks_added":0}
77782024-11-14T17:07:46.916ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77792024-11-14T17:07:46.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77802024-11-14T17:07:46.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77812024-11-14T17:07:46.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77822024-11-14T17:07:46.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77832024-11-14T17:07:46.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77842024-11-14T17:07:46.948ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
77852024-11-14T17:07:46.948ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4587581e-7a51-4b4e-8984-fe31145002a6", "content-length": "2", "date": "Thu, 14 Nov 2024 17:07:46 GMT"} })
77862024-11-14T17:07:46.950ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77872024-11-14T17:07:46.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77882024-11-14T17:07:46.959ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 249.231894ms iteration = 28 status = {}
77892024-11-14T17:07:46.963ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
77902024-11-14T17:07:46.963ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77912024-11-14T17:07:46.963ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f49950c4-825c-40c3-a2ba-dd9ac6cf2a0b", "content-length": "372", "date": "Thu, 14 Nov 2024 17:07:46 GMT"} })
77922024-11-14T17:07:46.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77932024-11-14T17:07:46.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77942024-11-14T17:07:46.966ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 256.006686ms iteration = 28 status = null
77952024-11-14T17:07:46.993ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77962024-11-14T17:07:46.996ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77972024-11-14T17:07:46.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77982024-11-14T17:07:46.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77992024-11-14T17:07:47.009ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
78002024-11-14T17:07:47.009ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
78012024-11-14T17:07:47.009ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "52afe18b-a5f1-4e87-81b8-9d56021f779d", "date": "Thu, 14 Nov 2024 17:07:46 GMT"} })
78022024-11-14T17:07:47.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78032024-11-14T17:07:47.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78042024-11-14T17:07:47.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78052024-11-14T17:07:47.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78062024-11-14T17:07:47.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78072024-11-14T17:07:47.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78082024-11-14T17:07:47.023ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
78092024-11-14T17:07:47.023ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78102024-11-14T17:07:47.023ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "397567a5-ec40-4e3f-890a-0acdd6e57452", "date": "Thu, 14 Nov 2024 17:07:46 GMT"} })
78112024-11-14T17:07:47.026ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 315.325824ms iteration = 30 status = {}
78122024-11-14T17:07:47.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78132024-11-14T17:07:47.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78142024-11-14T17:07:47.045ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
78152024-11-14T17:07:47.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78162024-11-14T17:07:47.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78172024-11-14T17:07:47.055ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
78182024-11-14T17:07:47.055ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e77c2c7-fceb-4393-8211-d29dcb7007d0", "content-length": "134", "date": "Thu, 14 Nov 2024 17:07:46 GMT"} })
78192024-11-14T17:07:47.055ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
78202024-11-14T17:07:47.055ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
78212024-11-14T17:07:47.055ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
78222024-11-14T17:07:47.055ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
78232024-11-14T17:07:47.055ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78242024-11-14T17:07:47.055ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78252024-11-14T17:07:47.055ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78262024-11-14T17:07:47.055ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78272024-11-14T17:07:47.055ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78282024-11-14T17:07:47.055ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78292024-11-14T17:07:47.055ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
78302024-11-14T17:07:47.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78312024-11-14T17:07:47.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78322024-11-14T17:07:47.058ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
78332024-11-14T17:07:47.058ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "20749d90-728b-4d85-9864-5942ff8f21e2", "content-length": "2", "date": "Thu, 14 Nov 2024 17:07:46 GMT"} })
78342024-11-14T17:07:47.058ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78352024-11-14T17:07:47.058ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b587f3b9-0660-49f9-987b-fbea0f5ca80c", "content-length": "52", "date": "Thu, 14 Nov 2024 17:07:46 GMT"} })
78362024-11-14T17:07:47.058ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
78372024-11-14T17:07:47.058ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
78382024-11-14T17:07:47.089ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
78392024-11-14T17:07:47.162ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3a964be-9c74-4a06-af65-228103a4c71b", "content-length": "691", "date": "Thu, 14 Nov 2024 17:07:47 GMT"} })
78402024-11-14T17:07:47.162ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
78412024-11-14T17:07:47.162ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
78422024-11-14T17:07:47.162ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
78432024-11-14T17:07:47.163ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 453.247697ms iteration = 29 status = {}
78442024-11-14T17:07:47.274ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c0a91dc9-af8b-48bb-bc16-30b8b8d7ae07", "date": "Thu, 14 Nov 2024 17:07:47 GMT"} })
78452024-11-14T17:07:47.274ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
78462024-11-14T17:07:47.274ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78472024-11-14T17:07:47.274ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd6b1c07-fac9-4c0e-97ef-d05cf18f8b5c", "content-length": "682", "date": "Thu, 14 Nov 2024 17:07:47 GMT"} })
78482024-11-14T17:07:47.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78492024-11-14T17:07:47.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78502024-11-14T17:07:47.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78512024-11-14T17:07:47.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78522024-11-14T17:07:47.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78532024-11-14T17:07:47.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78542024-11-14T17:07:47.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78552024-11-14T17:07:47.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78562024-11-14T17:07:47.292ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 581.339757ms iteration = 28 status = {}
78572024-11-14T17:07:47.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b841ec8f-1bdf-4c3e-90e1-e30847888142 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78582024-11-14T17:07:47.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b841ec8f-1bdf-4c3e-90e1-e30847888142 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78592024-11-14T17:07:47.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b841ec8f-1bdf-4c3e-90e1-e30847888142 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78602024-11-14T17:07:48.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 72673f39-b9c3-444d-afd1-a6a299faa745 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78612024-11-14T17:07:48.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 72673f39-b9c3-444d-afd1-a6a299faa745 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78622024-11-14T17:07:48.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 72673f39-b9c3-444d-afd1-a6a299faa745 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78632024-11-14T17:07:49.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bf080a95-73d7-47d2-a61d-b281dcf48a96 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78642024-11-14T17:07:49.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bf080a95-73d7-47d2-a61d-b281dcf48a96 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78652024-11-14T17:07:49.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bf080a95-73d7-47d2-a61d-b281dcf48a96 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78662024-11-14T17:07:50.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4634ffa9-08a7-4c29-b2b6-d2013b3f932c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78672024-11-14T17:07:50.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4634ffa9-08a7-4c29-b2b6-d2013b3f932c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78682024-11-14T17:07:50.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2669 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4634ffa9-08a7-4c29-b2b6-d2013b3f932c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78692024-11-14T17:07:51.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 663c0d59-2ee2-40b1-8825-446f3e275921 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78702024-11-14T17:07:51.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 663c0d59-2ee2-40b1-8825-446f3e275921 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78712024-11-14T17:07:51.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 663c0d59-2ee2-40b1-8825-446f3e275921 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78722024-11-14T17:07:52.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 68777c80-2ef9-4fe9-ab46-95ea3b8b03bc roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78732024-11-14T17:07:52.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 68777c80-2ef9-4fe9-ab46-95ea3b8b03bc resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78742024-11-14T17:07:52.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 68777c80-2ef9-4fe9-ab46-95ea3b8b03bc response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78752024-11-14T17:07:53.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d4a2557d-d4df-40a3-8afb-6bd3328a33ce roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78762024-11-14T17:07:53.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d4a2557d-d4df-40a3-8afb-6bd3328a33ce resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78772024-11-14T17:07:53.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d4a2557d-d4df-40a3-8afb-6bd3328a33ce response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78782024-11-14T17:07:54.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1a27f958-f659-4e0a-9c9a-4f734c38f393 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78792024-11-14T17:07:54.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1a27f958-f659-4e0a-9c9a-4f734c38f393 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78802024-11-14T17:07:54.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1a27f958-f659-4e0a-9c9a-4f734c38f393 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78812024-11-14T17:07:55.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 917378df-1e92-4fae-8a97-3a3577fa4b79 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78822024-11-14T17:07:55.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 917378df-1e92-4fae-8a97-3a3577fa4b79 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78832024-11-14T17:07:55.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 917378df-1e92-4fae-8a97-3a3577fa4b79 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78842024-11-14T17:07:56.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 97b35e5a-ffb9-4beb-bf83-6d40bf80cbca roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78852024-11-14T17:07:56.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 97b35e5a-ffb9-4beb-bf83-6d40bf80cbca resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78862024-11-14T17:07:56.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 97b35e5a-ffb9-4beb-bf83-6d40bf80cbca response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
78872024-11-14T17:07:56.607ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1482 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 417ca378-c7e2-4f16-865e-fc523286b795 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
78882024-11-14T17:07:56.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
78892024-11-14T17:07:56.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
78902024-11-14T17:07:56.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78912024-11-14T17:07:56.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78922024-11-14T17:07:56.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78932024-11-14T17:07:56.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78942024-11-14T17:07:56.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78952024-11-14T17:07:56.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78962024-11-14T17:07:56.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78972024-11-14T17:07:56.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78982024-11-14T17:07:56.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78992024-11-14T17:07:56.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79002024-11-14T17:07:56.741ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79012024-11-14T17:07:56.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79022024-11-14T17:07:56.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79032024-11-14T17:07:56.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
79042024-11-14T17:07:56.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79052024-11-14T17:07:56.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79062024-11-14T17:07:56.764ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
79072024-11-14T17:07:56.764ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.605012ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
79082024-11-14T17:07:56.774ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.323512ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79092024-11-14T17:07:57.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 252124c5-b8f5-4f90-8d41-f65501eab434 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79102024-11-14T17:07:57.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 252124c5-b8f5-4f90-8d41-f65501eab434 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79112024-11-14T17:07:57.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 252124c5-b8f5-4f90-8d41-f65501eab434 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79122024-11-14T17:07:58.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4d6b4323-8100-4a9d-b7ff-9911933512e9 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79132024-11-14T17:07:58.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4d6b4323-8100-4a9d-b7ff-9911933512e9 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79142024-11-14T17:07:58.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 4d6b4323-8100-4a9d-b7ff-9911933512e9 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79152024-11-14T17:07:59.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cdc6fc4d-5298-4cc4-94f2-ca3d68c69dd7 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79162024-11-14T17:07:59.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cdc6fc4d-5298-4cc4-94f2-ca3d68c69dd7 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79172024-11-14T17:07:59.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cdc6fc4d-5298-4cc4-94f2-ca3d68c69dd7 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79182024-11-14T17:08:00.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6acd4f7b-0e6e-41ed-876b-99cfeeaad76b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79192024-11-14T17:08:00.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6acd4f7b-0e6e-41ed-876b-99cfeeaad76b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79202024-11-14T17:08:00.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1778 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6acd4f7b-0e6e-41ed-876b-99cfeeaad76b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79212024-11-14T17:08:01.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0842e8ab-33d3-4af7-9706-0916ce353252 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79222024-11-14T17:08:01.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0842e8ab-33d3-4af7-9706-0916ce353252 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79232024-11-14T17:08:01.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0842e8ab-33d3-4af7-9706-0916ce353252 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79242024-11-14T17:08:02.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d61aaafc-664c-4ff4-aa92-b9e7c80e9089 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79252024-11-14T17:08:02.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d61aaafc-664c-4ff4-aa92-b9e7c80e9089 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79262024-11-14T17:08:02.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = d61aaafc-664c-4ff4-aa92-b9e7c80e9089 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79272024-11-14T17:08:03.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3e89840c-1c5c-4495-bd64-e8ee802ff228 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79282024-11-14T17:08:03.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3e89840c-1c5c-4495-bd64-e8ee802ff228 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79292024-11-14T17:08:03.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3e89840c-1c5c-4495-bd64-e8ee802ff228 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79302024-11-14T17:08:04.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b13da38b-6fad-4c43-9b27-f5107659fb34 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79312024-11-14T17:08:04.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b13da38b-6fad-4c43-9b27-f5107659fb34 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79322024-11-14T17:08:04.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b13da38b-6fad-4c43-9b27-f5107659fb34 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79332024-11-14T17:08:05.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b7a4cda3-a8e0-4d1c-bfc9-eb1e81b1ee5d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79342024-11-14T17:08:05.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b7a4cda3-a8e0-4d1c-bfc9-eb1e81b1ee5d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79352024-11-14T17:08:05.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b7a4cda3-a8e0-4d1c-bfc9-eb1e81b1ee5d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79362024-11-14T17:08:06.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
79372024-11-14T17:08:06.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79382024-11-14T17:08:06.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
79392024-11-14T17:08:06.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79402024-11-14T17:08:06.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79412024-11-14T17:08:06.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79422024-11-14T17:08:06.712ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79432024-11-14T17:08:06.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79442024-11-14T17:08:06.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79452024-11-14T17:08:06.714ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.334617ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79462024-11-14T17:08:06.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79472024-11-14T17:08:06.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79482024-11-14T17:08:06.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79492024-11-14T17:08:06.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79502024-11-14T17:08:06.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79512024-11-14T17:08:06.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79522024-11-14T17:08:06.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
79532024-11-14T17:08:06.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79542024-11-14T17:08:06.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79552024-11-14T17:08:06.737ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
79562024-11-14T17:08:06.737ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.89841ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
79572024-11-14T17:08:06.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 99ecabae-2bb3-4a96-b224-d2fcf3748ab3 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79582024-11-14T17:08:06.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 99ecabae-2bb3-4a96-b224-d2fcf3748ab3 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79592024-11-14T17:08:06.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 99ecabae-2bb3-4a96-b224-d2fcf3748ab3 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79602024-11-14T17:08:07.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2ccdc24b-7880-4137-9cfe-af35c74b7b89 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79612024-11-14T17:08:07.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2ccdc24b-7880-4137-9cfe-af35c74b7b89 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79622024-11-14T17:08:07.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2ccdc24b-7880-4137-9cfe-af35c74b7b89 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79632024-11-14T17:08:08.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 59114669-5558-4d90-a913-159e3806d2ab roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
79642024-11-14T17:08:08.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 59114669-5558-4d90-a913-159e3806d2ab resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
79652024-11-14T17:08:08.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = 59114669-5558-4d90-a913-159e3806d2ab response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
79662024-11-14T17:08:08.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c5273bb0-28d2-4500-9dfe-9ce9eeca7065 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79672024-11-14T17:08:08.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c5273bb0-28d2-4500-9dfe-9ce9eeca7065 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79682024-11-14T17:08:08.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c5273bb0-28d2-4500-9dfe-9ce9eeca7065 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79692024-11-14T17:08:09.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 68e9594c-8b74-48a8-9be3-afe2b6261d9c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79702024-11-14T17:08:09.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 68e9594c-8b74-48a8-9be3-afe2b6261d9c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79712024-11-14T17:08:09.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 68e9594c-8b74-48a8-9be3-afe2b6261d9c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79722024-11-14T17:08:10.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fc90f4ed-79b9-4285-a516-985806858fa9 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79732024-11-14T17:08:10.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fc90f4ed-79b9-4285-a516-985806858fa9 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79742024-11-14T17:08:10.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = fc90f4ed-79b9-4285-a516-985806858fa9 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79752024-11-14T17:08:11.607ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1366 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 1ab3005f-5d44-4d0f-be99-59b5e469774f response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
79762024-11-14T17:08:11.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = faacb882-61f1-44ab-833a-0a40c6efa1d7 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79772024-11-14T17:08:11.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = faacb882-61f1-44ab-833a-0a40c6efa1d7 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79782024-11-14T17:08:11.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = faacb882-61f1-44ab-833a-0a40c6efa1d7 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79792024-11-14T17:08:12.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dcbca61e-5f98-4a62-a9a4-e48f66b0e872 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79802024-11-14T17:08:12.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dcbca61e-5f98-4a62-a9a4-e48f66b0e872 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79812024-11-14T17:08:12.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dcbca61e-5f98-4a62-a9a4-e48f66b0e872 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79822024-11-14T17:08:13.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3558ba0d-9e12-4e45-bb7d-c00034f5071d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79832024-11-14T17:08:13.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3558ba0d-9e12-4e45-bb7d-c00034f5071d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79842024-11-14T17:08:13.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3558ba0d-9e12-4e45-bb7d-c00034f5071d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79852024-11-14T17:08:14.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8319116d-fc64-454f-a67e-4b33bc8f5e3b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79862024-11-14T17:08:14.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8319116d-fc64-454f-a67e-4b33bc8f5e3b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79872024-11-14T17:08:14.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 8319116d-fc64-454f-a67e-4b33bc8f5e3b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79882024-11-14T17:08:15.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 159ed29f-11e2-4d3d-960a-5b6bc940da6c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79892024-11-14T17:08:15.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 159ed29f-11e2-4d3d-960a-5b6bc940da6c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79902024-11-14T17:08:15.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 159ed29f-11e2-4d3d-960a-5b6bc940da6c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
79912024-11-14T17:08:16.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 80689287-87ec-4367-b589-12d13584c358 roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
79922024-11-14T17:08:16.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 80689287-87ec-4367-b589-12d13584c358 resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
79932024-11-14T17:08:16.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 80689287-87ec-4367-b589-12d13584c358 response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
79942024-11-14T17:08:16.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 4facacf5-7b34-4f8e-a221-d8166cc1cdd7 roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
79952024-11-14T17:08:16.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 4facacf5-7b34-4f8e-a221-d8166cc1cdd7 resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
79962024-11-14T17:08:16.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 4facacf5-7b34-4f8e-a221-d8166cc1cdd7 response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
79972024-11-14T17:08:16.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
79982024-11-14T17:08:16.710ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
79992024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80002024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
80012024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
80022024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80032024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80042024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
80052024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
80062024-11-14T17:08:16.711ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
80072024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80082024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80092024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
80102024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80112024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
80122024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80132024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
80142024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80152024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
80162024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80172024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
80182024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80192024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
80202024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80212024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
80222024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80232024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
80242024-11-14T17:08:16.711ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5
80252024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
80262024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 25.881\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5"}
80272024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80282024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
80292024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
80302024-11-14T17:08:16.711ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 16:58:16.711237382 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
80312024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80322024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
80332024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
80342024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
80352024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80362024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
80372024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
80382024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
80392024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
80402024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
80412024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
80422024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
80432024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
80442024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
80452024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
80462024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
80472024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
80482024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80492024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
80502024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80512024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80522024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80532024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80542024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
80552024-11-14T17:08:16.711ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
80562024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
80572024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
80582024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
80592024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
80602024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
80612024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80622024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
80632024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80642024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80652024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80662024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80672024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80682024-11-14T17:08:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80692024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
80702024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80712024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80722024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
80732024-11-14T17:08:16.712ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94482e71-9503-4d09-b73f-615fbf343a2e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("cb30b954-f678-488f-bf13-6a751f361b3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2620, tv_nsec: 440235286 } })
80742024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
80752024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
80762024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
80772024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80782024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80792024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
80802024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
80812024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
80822024-11-14T17:08:16.712ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89b01be2-c37f-445d-addd-6b4be9cd73c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc5fdca1-6d92-4ff4-b5ae-2f44553a2186.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c3fb510c-8c5c-4a83-b5d7-4e199ba14057.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2620, tv_nsec: 440323408 } })
80832024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80842024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80852024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
80862024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.158836ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
80872024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
80882024-11-14T17:08:16.712ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.226877ms iteration = 16 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
80892024-11-14T17:08:16.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80902024-11-14T17:08:16.714ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80912024-11-14T17:08:16.714ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80922024-11-14T17:08:16.716ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80932024-11-14T17:08:16.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80942024-11-14T17:08:16.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80952024-11-14T17:08:16.717ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
80962024-11-14T17:08:16.717ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80972024-11-14T17:08:16.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80982024-11-14T17:08:16.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80992024-11-14T17:08:16.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81002024-11-14T17:08:16.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81012024-11-14T17:08:16.717ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.20321ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
81022024-11-14T17:08:16.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81032024-11-14T17:08:16.721ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81042024-11-14T17:08:16.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
81052024-11-14T17:08:16.722ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81062024-11-14T17:08:16.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81072024-11-14T17:08:16.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81082024-11-14T17:08:16.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81092024-11-14T17:08:16.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81102024-11-14T17:08:16.726ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 16:58:16.711237382 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
81112024-11-14T17:08:16.726ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.246964ms iteration = 15 status = {"expiration":"2024-11-14T16:58:16.711237382Z","pruned":[]}
81122024-11-14T17:08:16.727ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2620, tv_nsec: 455609073 } })
81132024-11-14T17:08:16.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81142024-11-14T17:08:16.727ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
81152024-11-14T17:08:16.728ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2620, tv_nsec: 456621406 } })
81162024-11-14T17:08:16.728ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
81172024-11-14T17:08:16.729ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.040387ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
81182024-11-14T17:08:16.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
81192024-11-14T17:08:16.730ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81202024-11-14T17:08:16.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81212024-11-14T17:08:16.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81222024-11-14T17:08:16.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81232024-11-14T17:08:16.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81242024-11-14T17:08:16.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81252024-11-14T17:08:16.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81262024-11-14T17:08:16.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81272024-11-14T17:08:16.738ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81282024-11-14T17:08:16.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81292024-11-14T17:08:16.739ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81302024-11-14T17:08:16.739ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2620, tv_nsec: 467434070 } })
81312024-11-14T17:08:16.739ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
81322024-11-14T17:08:16.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81332024-11-14T17:08:16.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81342024-11-14T17:08:16.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81352024-11-14T17:08:16.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
81362024-11-14T17:08:16.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81372024-11-14T17:08:16.765ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81382024-11-14T17:08:16.766ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81392024-11-14T17:08:16.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81402024-11-14T17:08:16.768ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81412024-11-14T17:08:16.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81422024-11-14T17:08:16.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
81432024-11-14T17:08:16.770ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81442024-11-14T17:08:16.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81452024-11-14T17:08:16.779ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81462024-11-14T17:08:16.782ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81472024-11-14T17:08:16.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81482024-11-14T17:08:16.782ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81492024-11-14T17:08:16.782ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
81502024-11-14T17:08:16.782ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81512024-11-14T17:08:16.783ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81522024-11-14T17:08:16.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81532024-11-14T17:08:16.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81542024-11-14T17:08:16.784ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81552024-11-14T17:08:16.784ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.028008ms iteration = 29 status = {"errors":[],"records_set_to_done":[]}
81562024-11-14T17:08:16.784ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81572024-11-14T17:08:16.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81582024-11-14T17:08:16.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81592024-11-14T17:08:16.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
81602024-11-14T17:08:16.784ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81612024-11-14T17:08:16.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81622024-11-14T17:08:16.799ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81632024-11-14T17:08:16.799ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
81642024-11-14T17:08:16.799ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81652024-11-14T17:08:16.799ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81662024-11-14T17:08:16.799ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
81672024-11-14T17:08:16.799ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
81682024-11-14T17:08:16.799ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 88.343193ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
81692024-11-14T17:08:16.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81702024-11-14T17:08:16.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81712024-11-14T17:08:16.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81722024-11-14T17:08:16.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 90.40623ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
81732024-11-14T17:08:16.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81742024-11-14T17:08:16.803ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81752024-11-14T17:08:16.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81762024-11-14T17:08:16.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81772024-11-14T17:08:16.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81782024-11-14T17:08:16.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81792024-11-14T17:08:16.816ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81802024-11-14T17:08:16.816ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
81812024-11-14T17:08:16.817ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 105.759336ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
81822024-11-14T17:08:16.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
81832024-11-14T17:08:16.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81842024-11-14T17:08:16.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81852024-11-14T17:08:16.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
81862024-11-14T17:08:16.819ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
81872024-11-14T17:08:16.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
81882024-11-14T17:08:16.823ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
81892024-11-14T17:08:16.823ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
81902024-11-14T17:08:16.823ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
81912024-11-14T17:08:16.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81922024-11-14T17:08:16.823ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
81932024-11-14T17:08:16.823ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
81942024-11-14T17:08:16.823ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
81952024-11-14T17:08:16.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81962024-11-14T17:08:16.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81972024-11-14T17:08:16.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81982024-11-14T17:08:16.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81992024-11-14T17:08:16.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82002024-11-14T17:08:16.829ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82012024-11-14T17:08:16.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82022024-11-14T17:08:16.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82032024-11-14T17:08:16.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82042024-11-14T17:08:16.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82052024-11-14T17:08:16.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82062024-11-14T17:08:16.834ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82072024-11-14T17:08:16.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82082024-11-14T17:08:16.835ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82092024-11-14T17:08:16.838ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
82102024-11-14T17:08:16.838ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82112024-11-14T17:08:16.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82122024-11-14T17:08:16.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82132024-11-14T17:08:16.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82142024-11-14T17:08:16.840ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
82152024-11-14T17:08:16.840ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
82162024-11-14T17:08:16.840ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82172024-11-14T17:08:16.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82182024-11-14T17:08:16.841ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
82192024-11-14T17:08:16.841ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 130.148886ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
82202024-11-14T17:08:16.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82212024-11-14T17:08:16.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82222024-11-14T17:08:16.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82232024-11-14T17:08:16.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
82242024-11-14T17:08:16.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
82252024-11-14T17:08:16.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82262024-11-14T17:08:16.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82272024-11-14T17:08:16.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82282024-11-14T17:08:16.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 137.110483ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
82292024-11-14T17:08:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82302024-11-14T17:08:16.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82312024-11-14T17:08:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82322024-11-14T17:08:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
82332024-11-14T17:08:16.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82342024-11-14T17:08:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82352024-11-14T17:08:16.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 140.842277ms iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
82362024-11-14T17:08:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 141.342429ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
82372024-11-14T17:08:16.853ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82382024-11-14T17:08:16.853ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
82392024-11-14T17:08:16.853ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.126756ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
82402024-11-14T17:08:16.853ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = da4cfd94-45f4-4b16-abae-e979d3853f86 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
82412024-11-14T17:08:16.853ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
82422024-11-14T17:08:16.853ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 16:54:46.198050 UTC dns_group = internal generation = 1
82432024-11-14T17:08:16.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 142.747901ms iteration = 16 status = {"generation":1}
82442024-11-14T17:08:16.853ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 142.69534ms iteration = 29 status = 0
82452024-11-14T17:08:16.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 142.682959ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82462024-11-14T17:08:16.858ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82472024-11-14T17:08:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82482024-11-14T17:08:16.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82492024-11-14T17:08:16.864ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82502024-11-14T17:08:16.864ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82512024-11-14T17:08:16.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82522024-11-14T17:08:16.892ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
82532024-11-14T17:08:16.892ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
82542024-11-14T17:08:16.892ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 181.189528ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
82552024-11-14T17:08:16.893ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
82562024-11-14T17:08:16.893ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82572024-11-14T17:08:16.893ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db091592-7257-4493-80ef-9185c024b20a", "content-length": "26", "date": "Thu, 14 Nov 2024 17:08:16 GMT"} })
82582024-11-14T17:08:16.893ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82592024-11-14T17:08:16.895ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82602024-11-14T17:08:16.897ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
82612024-11-14T17:08:16.897ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 0 version = 2
82622024-11-14T17:08:16.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82632024-11-14T17:08:16.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82642024-11-14T17:08:16.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82652024-11-14T17:08:16.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82662024-11-14T17:08:16.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82672024-11-14T17:08:16.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82682024-11-14T17:08:16.913ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T16:54:14.392760Z, time_modified: 2024-11-14T16:54:14.392760Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, db_silo: Silo { identity: SiloIdentity { id: 11404bb1-6f48-4205-9676-954f6fc87352, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T16:54:47.417248Z, time_modified: 2024-11-14T16:54:47.417248Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb" }] }) }
82692024-11-14T17:08:16.913ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 202.841526ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]}},"default_endpoint":{"silo_id":"11404bb1-6f48-4205-9676-954f6fc87352","tls_certs":["4bd9fd776b39fb08f0ddfd773c9f70d1b4bfb1aa4aa304999b20caedc06036cb"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
82702024-11-14T17:08:16.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82712024-11-14T17:08:16.919ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = bf79f31b-6c5b-45cd-ba24-7882adce1e8c dns_zone_name = oxide.test found_so_far = 1 version = 2
82722024-11-14T17:08:16.919ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
82732024-11-14T17:08:16.919ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 16:54:47.468912 UTC dns_group = external generation = 2
82742024-11-14T17:08:16.919ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 207.906341ms iteration = 16 status = {"generation":2}
82752024-11-14T17:08:16.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82762024-11-14T17:08:16.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82772024-11-14T17:08:16.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82782024-11-14T17:08:16.932ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
82792024-11-14T17:08:16.944ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
82802024-11-14T17:08:16.972ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 261.240854ms iteration = 33 status = {"physical_disks_added":0}
82812024-11-14T17:08:17.001ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
82822024-11-14T17:08:17.001ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82832024-11-14T17:08:17.002ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "36489fd7-d8ba-440b-8dc8-b27ba18402e2", "content-length": "26", "date": "Thu, 14 Nov 2024 17:08:16 GMT"} })
82842024-11-14T17:08:17.002ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82852024-11-14T17:08:17.004ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82862024-11-14T17:08:17.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 253b1947-40ec-4248-91c8-9361c50c27e8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
82872024-11-14T17:08:17.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 253b1947-40ec-4248-91c8-9361c50c27e8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
82882024-11-14T17:08:17.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 253b1947-40ec-4248-91c8-9361c50c27e8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
82892024-11-14T17:08:17.025ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
82902024-11-14T17:08:17.025ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 314.402544ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
82912024-11-14T17:08:17.096ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
82922024-11-14T17:08:17.096ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82932024-11-14T17:08:17.096ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fabaa13-56d6-47b8-a6eb-eacda83cf517", "content-length": "26", "date": "Thu, 14 Nov 2024 17:08:16 GMT"} })
82942024-11-14T17:08:17.096ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82952024-11-14T17:08:17.098ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
82962024-11-14T17:08:17.133ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
82972024-11-14T17:08:17.133ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "97138426-f1ab-4e50-b26d-e6c515b88dcf", "content-length": "691", "date": "Thu, 14 Nov 2024 17:08:17 GMT"} })
82982024-11-14T17:08:17.133ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
82992024-11-14T17:08:17.133ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
83002024-11-14T17:08:17.133ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
83012024-11-14T17:08:17.135ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 424.272622ms iteration = 30 status = {}
83022024-11-14T17:08:17.210ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
83032024-11-14T17:08:17.279ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
83042024-11-14T17:08:17.279ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "98231bd0-2c76-47b5-af40-9718a271bdc6", "date": "Thu, 14 Nov 2024 17:08:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
83052024-11-14T17:08:17.279ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
83062024-11-14T17:08:17.281ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "adb46ac7-d25e-4c91-a960-97a418838492", "date": "Thu, 14 Nov 2024 17:08:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
83072024-11-14T17:08:17.281ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
83082024-11-14T17:08:17.283ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
83092024-11-14T17:08:17.283ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 571.7794ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
83102024-11-14T17:08:17.318ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 606.896723ms iteration = 29 status = {}
83112024-11-14T17:08:17.326ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
83122024-11-14T17:08:17.326ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83132024-11-14T17:08:17.342ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
83142024-11-14T17:08:17.342ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "10ed0671-e6c1-463b-b8e5-4dfde5eb9f77", "content-length": "2", "date": "Thu, 14 Nov 2024 17:08:17 GMT"} })
83152024-11-14T17:08:17.344ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83162024-11-14T17:08:17.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83172024-11-14T17:08:17.346ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 635.285763ms iteration = 29 status = null
83182024-11-14T17:08:17.348ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
83192024-11-14T17:08:17.348ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c8ee422f-9367-4f70-a4c4-24987b92ba27", "date": "Thu, 14 Nov 2024 17:08:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
83202024-11-14T17:08:17.348ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
83212024-11-14T17:08:17.350ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0bae5037-5c8f-43fd-8346-03a0f2b9e887", "date": "Thu, 14 Nov 2024 17:08:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
83222024-11-14T17:08:17.350ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
83232024-11-14T17:08:17.351ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "67ffa19b-8443-4bc4-bf72-05cabf0fed6a", "date": "Thu, 14 Nov 2024 17:08:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
83242024-11-14T17:08:17.351ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
83252024-11-14T17:08:17.353ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
83262024-11-14T17:08:17.353ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 642.64329ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
83272024-11-14T17:08:17.377ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c1675a5-70e4-40f7-b75c-477dd3008c4e", "content-length": "372", "date": "Thu, 14 Nov 2024 17:08:17 GMT"} })
83282024-11-14T17:08:17.377ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83292024-11-14T17:08:17.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83302024-11-14T17:08:17.391ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
83312024-11-14T17:08:17.391ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
83322024-11-14T17:08:17.391ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "634b25c4-1a19-4586-8729-8231c569d10e", "date": "Thu, 14 Nov 2024 17:08:17 GMT"} })
83332024-11-14T17:08:17.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83342024-11-14T17:08:17.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83352024-11-14T17:08:17.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83362024-11-14T17:08:17.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83372024-11-14T17:08:17.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83382024-11-14T17:08:17.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83392024-11-14T17:08:17.399ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
83402024-11-14T17:08:17.399ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83412024-11-14T17:08:17.400ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "12938fa8-f9b6-4f8a-9624-f976babb5d1b", "date": "Thu, 14 Nov 2024 17:08:17 GMT"} })
83422024-11-14T17:08:17.401ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 690.53572ms iteration = 31 status = {}
83432024-11-14T17:08:17.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83442024-11-14T17:08:17.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83452024-11-14T17:08:17.405ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
83462024-11-14T17:08:17.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83472024-11-14T17:08:17.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83482024-11-14T17:08:17.415ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
83492024-11-14T17:08:17.415ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0475979-fecd-40c8-ab5a-92ff4fc9511a", "content-length": "134", "date": "Thu, 14 Nov 2024 17:08:17 GMT"} })
83502024-11-14T17:08:17.415ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
83512024-11-14T17:08:17.415ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
83522024-11-14T17:08:17.415ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
83532024-11-14T17:08:17.415ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
83542024-11-14T17:08:17.415ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83552024-11-14T17:08:17.415ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83562024-11-14T17:08:17.415ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83572024-11-14T17:08:17.415ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83582024-11-14T17:08:17.415ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83592024-11-14T17:08:17.415ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83602024-11-14T17:08:17.415ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
83612024-11-14T17:08:17.415ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83622024-11-14T17:08:17.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83632024-11-14T17:08:17.418ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
83642024-11-14T17:08:17.418ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2066cc00-649f-4c74-a1a2-0485cb2a0ded", "content-length": "2", "date": "Thu, 14 Nov 2024 17:08:17 GMT"} })
83652024-11-14T17:08:17.418ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
83662024-11-14T17:08:17.418ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "63171201-9d25-4b20-a998-359e16ff4fdc", "content-length": "52", "date": "Thu, 14 Nov 2024 17:08:17 GMT"} })
83672024-11-14T17:08:17.418ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
83682024-11-14T17:08:17.418ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
83692024-11-14T17:08:17.617ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "88bddb44-6f66-4fe7-8503-298389997989", "date": "Thu, 14 Nov 2024 17:08:17 GMT"} })
83702024-11-14T17:08:17.617ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
83712024-11-14T17:08:17.617ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
83722024-11-14T17:08:17.617ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "69ed8b55-2d04-40e6-beb8-00f13583868c", "content-length": "682", "date": "Thu, 14 Nov 2024 17:08:17 GMT"} })
83732024-11-14T17:08:17.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83742024-11-14T17:08:17.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83752024-11-14T17:08:17.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83762024-11-14T17:08:17.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83772024-11-14T17:08:17.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83782024-11-14T17:08:17.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83792024-11-14T17:08:17.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83802024-11-14T17:08:17.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83812024-11-14T17:08:17.637ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 926.042193ms iteration = 29 status = {}
83822024-11-14T17:08:18.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0296b17e-407d-4071-bf2c-0f1a7824e07a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83832024-11-14T17:08:18.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0296b17e-407d-4071-bf2c-0f1a7824e07a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83842024-11-14T17:08:18.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 0296b17e-407d-4071-bf2c-0f1a7824e07a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83852024-11-14T17:08:19.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = eb70fbd0-f57a-4719-bffb-0662256ef36b roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83862024-11-14T17:08:19.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = eb70fbd0-f57a-4719-bffb-0662256ef36b resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83872024-11-14T17:08:19.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = eb70fbd0-f57a-4719-bffb-0662256ef36b response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83882024-11-14T17:08:20.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 594b8ce9-9b65-4381-9843-50aa41dde8d0 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83892024-11-14T17:08:20.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 594b8ce9-9b65-4381-9843-50aa41dde8d0 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83902024-11-14T17:08:20.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 594b8ce9-9b65-4381-9843-50aa41dde8d0 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83912024-11-14T17:08:21.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 445f88e0-9899-42ab-9e00-dd92842791c5 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83922024-11-14T17:08:21.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 445f88e0-9899-42ab-9e00-dd92842791c5 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83932024-11-14T17:08:21.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 445f88e0-9899-42ab-9e00-dd92842791c5 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83942024-11-14T17:08:22.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ddf94af1-a5f0-4685-8308-cae058e28de4 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83952024-11-14T17:08:22.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ddf94af1-a5f0-4685-8308-cae058e28de4 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83962024-11-14T17:08:22.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ddf94af1-a5f0-4685-8308-cae058e28de4 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83972024-11-14T17:08:23.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 62505a45-0a4b-41fb-aa69-510235c13099 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83982024-11-14T17:08:23.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 62505a45-0a4b-41fb-aa69-510235c13099 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
83992024-11-14T17:08:23.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 62505a45-0a4b-41fb-aa69-510235c13099 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84002024-11-14T17:08:24.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 34e8f8ff-badf-432c-b1e7-0180ef8d92ea roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84012024-11-14T17:08:24.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 34e8f8ff-badf-432c-b1e7-0180ef8d92ea resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84022024-11-14T17:08:24.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 34e8f8ff-badf-432c-b1e7-0180ef8d92ea response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84032024-11-14T17:08:25.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c44f26b5-fd18-4369-b350-99738d5b9a82 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84042024-11-14T17:08:25.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c44f26b5-fd18-4369-b350-99738d5b9a82 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84052024-11-14T17:08:25.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = c44f26b5-fd18-4369-b350-99738d5b9a82 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84062024-11-14T17:08:26.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3754d2e2-c447-4c20-8403-83252fede109 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84072024-11-14T17:08:26.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3754d2e2-c447-4c20-8403-83252fede109 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84082024-11-14T17:08:26.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3754d2e2-c447-4c20-8403-83252fede109 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84092024-11-14T17:08:26.608ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1492 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = 3cd53fef-c567-42f2-b563-0f590c6b7e56 response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
84102024-11-14T17:08:26.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
84112024-11-14T17:08:26.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
84122024-11-14T17:08:26.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84132024-11-14T17:08:26.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84142024-11-14T17:08:26.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84152024-11-14T17:08:26.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84162024-11-14T17:08:26.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84172024-11-14T17:08:26.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84182024-11-14T17:08:26.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84192024-11-14T17:08:26.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84202024-11-14T17:08:26.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84212024-11-14T17:08:26.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84222024-11-14T17:08:26.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84232024-11-14T17:08:26.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
84242024-11-14T17:08:26.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84252024-11-14T17:08:26.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84262024-11-14T17:08:26.730ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
84272024-11-14T17:08:26.730ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.601325ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
84282024-11-14T17:08:26.748ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84292024-11-14T17:08:26.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84302024-11-14T17:08:26.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.248164ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84312024-11-14T17:08:27.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1fed54f4-fdc8-47fa-881a-04ab13ae74db roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84322024-11-14T17:08:27.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1fed54f4-fdc8-47fa-881a-04ab13ae74db resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84332024-11-14T17:08:27.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 1fed54f4-fdc8-47fa-881a-04ab13ae74db response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84342024-11-14T17:08:28.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 39f5595b-ace1-45d3-abf4-7fd8ddcba854 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84352024-11-14T17:08:28.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 39f5595b-ace1-45d3-abf4-7fd8ddcba854 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84362024-11-14T17:08:28.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 39f5595b-ace1-45d3-abf4-7fd8ddcba854 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84372024-11-14T17:08:29.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ff94c5ef-826b-4fa3-a6c3-fd648218a314 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84382024-11-14T17:08:29.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ff94c5ef-826b-4fa3-a6c3-fd648218a314 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84392024-11-14T17:08:29.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ff94c5ef-826b-4fa3-a6c3-fd648218a314 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84402024-11-14T17:08:30.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 03abb48c-048a-40e6-a673-8c1ffa0142ff roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84412024-11-14T17:08:30.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 03abb48c-048a-40e6-a673-8c1ffa0142ff resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84422024-11-14T17:08:30.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 03abb48c-048a-40e6-a673-8c1ffa0142ff response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84432024-11-14T17:08:31.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 60472016-3ccb-45ca-b0d7-22cac5088654 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84442024-11-14T17:08:31.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 60472016-3ccb-45ca-b0d7-22cac5088654 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84452024-11-14T17:08:31.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 60472016-3ccb-45ca-b0d7-22cac5088654 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84462024-11-14T17:08:32.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a422f2fd-efbf-4b92-b7f7-6a01d507b1bd roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84472024-11-14T17:08:32.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a422f2fd-efbf-4b92-b7f7-6a01d507b1bd resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84482024-11-14T17:08:32.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = a422f2fd-efbf-4b92-b7f7-6a01d507b1bd response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84492024-11-14T17:08:33.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ad786e7c-12f0-4709-bc62-ff3a820a9dbd roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84502024-11-14T17:08:33.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ad786e7c-12f0-4709-bc62-ff3a820a9dbd resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84512024-11-14T17:08:33.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = ad786e7c-12f0-4709-bc62-ff3a820a9dbd response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84522024-11-14T17:08:34.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9245876c-bfba-4b2e-a8ef-b820763bb9b6 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84532024-11-14T17:08:34.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9245876c-bfba-4b2e-a8ef-b820763bb9b6 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84542024-11-14T17:08:34.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9245876c-bfba-4b2e-a8ef-b820763bb9b6 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84552024-11-14T17:08:35.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bd4196e4-12b1-444e-b688-10ac6c902df4 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84562024-11-14T17:08:35.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bd4196e4-12b1-444e-b688-10ac6c902df4 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84572024-11-14T17:08:35.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = bd4196e4-12b1-444e-b688-10ac6c902df4 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84582024-11-14T17:08:36.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = eb248573-f6e5-4400-8a0e-1726dadd56b8 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84592024-11-14T17:08:36.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = eb248573-f6e5-4400-8a0e-1726dadd56b8 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84602024-11-14T17:08:36.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = eb248573-f6e5-4400-8a0e-1726dadd56b8 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84612024-11-14T17:08:36.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
84622024-11-14T17:08:36.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
84632024-11-14T17:08:36.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84642024-11-14T17:08:36.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84652024-11-14T17:08:36.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84662024-11-14T17:08:36.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84672024-11-14T17:08:36.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84682024-11-14T17:08:36.714ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84692024-11-14T17:08:36.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84702024-11-14T17:08:36.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84712024-11-14T17:08:36.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84722024-11-14T17:08:36.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84732024-11-14T17:08:36.715ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.139896ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84742024-11-14T17:08:36.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84752024-11-14T17:08:36.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84762024-11-14T17:08:36.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84772024-11-14T17:08:36.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
84782024-11-14T17:08:36.721ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84792024-11-14T17:08:36.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84802024-11-14T17:08:36.730ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
84812024-11-14T17:08:36.730ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.591792ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
84822024-11-14T17:08:37.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 16bd4ce7-28b5-4127-aca8-76146586f779 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84832024-11-14T17:08:37.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 16bd4ce7-28b5-4127-aca8-76146586f779 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84842024-11-14T17:08:37.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 16bd4ce7-28b5-4127-aca8-76146586f779 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84852024-11-14T17:08:38.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dd6e7dd0-14c9-4c5b-9de4-fb933f679adb roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84862024-11-14T17:08:38.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dd6e7dd0-14c9-4c5b-9de4-fb933f679adb resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84872024-11-14T17:08:38.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = dd6e7dd0-14c9-4c5b-9de4-fb933f679adb response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84882024-11-14T17:08:38.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = b0bb6dbd-ee25-4cb3-851a-fede7394e14d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
84892024-11-14T17:08:38.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = b0bb6dbd-ee25-4cb3-851a-fede7394e14d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
84902024-11-14T17:08:38.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:58323 req_id = b0bb6dbd-ee25-4cb3-851a-fede7394e14d response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
84912024-11-14T17:08:39.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 92fe4076-fdce-4460-b9ea-b7777acd4adc roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84922024-11-14T17:08:39.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 92fe4076-fdce-4460-b9ea-b7777acd4adc resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84932024-11-14T17:08:39.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 92fe4076-fdce-4460-b9ea-b7777acd4adc response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84942024-11-14T17:08:40.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6d64550f-a7ef-4270-a7a1-5dd79c3e228e roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84952024-11-14T17:08:40.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6d64550f-a7ef-4270-a7a1-5dd79c3e228e resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84962024-11-14T17:08:40.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 6d64550f-a7ef-4270-a7a1-5dd79c3e228e response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84972024-11-14T17:08:41.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = db8dbf45-e286-4d73-8324-f480438618c7 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84982024-11-14T17:08:41.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = db8dbf45-e286-4d73-8324-f480438618c7 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
84992024-11-14T17:08:41.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = db8dbf45-e286-4d73-8324-f480438618c7 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
85002024-11-14T17:08:41.607ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::b]:53171 method = GET remote_addr = [fd00:1122:3344:101::d]:46596 req_id = c9c9eb63-12c5-4c40-8055-9515c107b52e response_code = 200 uri = /0cc022d1-76d3-4a28-8e75-e8e958faa197
85012024-11-14T17:08:42.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 972f4116-129e-4741-858c-1f30b4a964a7 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
85022024-11-14T17:08:42.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 972f4116-129e-4741-858c-1f30b4a964a7 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
85032024-11-14T17:08:42.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 972f4116-129e-4741-858c-1f30b4a964a7 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
85042024-11-14T17:08:43.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 599897f9-c789-4707-91f0-98be6a771ade roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
85052024-11-14T17:08:43.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 599897f9-c789-4707-91f0-98be6a771ade resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
85062024-11-14T17:08:43.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2541 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 599897f9-c789-4707-91f0-98be6a771ade response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
85072024-11-14T17:08:44.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 469a199a-108f-4304-add9-f0339050ca37 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
85082024-11-14T17:08:44.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 469a199a-108f-4304-add9-f0339050ca37 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
85092024-11-14T17:08:44.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 469a199a-108f-4304-add9-f0339050ca37 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
85102024-11-14T17:08:45.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9c399ee2-57af-45ac-bcc2-8b4de4d29312 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
85112024-11-14T17:08:45.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9c399ee2-57af-45ac-bcc2-8b4de4d29312 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
85122024-11-14T17:08:45.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 9c399ee2-57af-45ac-bcc2-8b4de4d29312 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
85132024-11-14T17:08:46.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 560fd812-e6a2-4e77-a2df-563754d56008 roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
85142024-11-14T17:08:46.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 560fd812-e6a2-4e77-a2df-563754d56008 resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
85152024-11-14T17:08:46.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 560fd812-e6a2-4e77-a2df-563754d56008 response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?sort_by=id_ascending
85162024-11-14T17:08:46.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 3274f9e5-61ca-4fb8-8edc-d6a9414dff73 roles = RoleSet { roles: {} } uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
85172024-11-14T17:08:46.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 3274f9e5-61ca-4fb8-8edc-d6a9414dff73 resource = Database result = Ok(()) uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
85182024-11-14T17:08:46.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54959 req_id = 3274f9e5-61ca-4fb8-8edc-d6a9414dff73 response_code = 200 uri = /metrics/collectors/eb1db522-cd7d-4b64-9412-796885aef8d2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzBmYmY3NC03NDg5LTQzOWYtOGVjMy1lNmU4NDczYThiNDMifX0%3D
85192024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
85202024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
85212024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85222024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
85232024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85242024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85252024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
85262024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
85272024-11-14T17:08:46.710ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
85282024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85292024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
85302024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85312024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85322024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
85332024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85342024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
85352024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
85362024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
85372024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
85382024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
85392024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85402024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
85412024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85422024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
85432024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
85442024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85452024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85462024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85472024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85482024-11-14T17:08:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85492024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85502024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85512024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
85522024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85532024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85542024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85552024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85562024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85572024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85582024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
85592024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
85602024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85612024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
85622024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
85632024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85642024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
85652024-11-14T17:08:46.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
85662024-11-14T17:08:46.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
85672024-11-14T17:08:46.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85682024-11-14T17:08:46.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
85692024-11-14T17:08:46.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85702024-11-14T17:08:46.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85712024-11-14T17:08:46.713ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85722024-11-14T17:08:46.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85732024-11-14T17:08:46.713ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.264664ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85742024-11-14T17:08:46.714ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85752024-11-14T17:08:46.714ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85762024-11-14T17:08:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85772024-11-14T17:08:46.716ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85782024-11-14T17:08:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85792024-11-14T17:08:46.717ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85802024-11-14T17:08:46.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85812024-11-14T17:08:46.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85822024-11-14T17:08:46.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85832024-11-14T17:08:46.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85842024-11-14T17:08:46.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85852024-11-14T17:08:46.718ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85862024-11-14T17:08:46.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85872024-11-14T17:08:46.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85882024-11-14T17:08:46.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
85892024-11-14T17:08:46.718ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85902024-11-14T17:08:46.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85912024-11-14T17:08:46.720ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85922024-11-14T17:08:46.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85932024-11-14T17:08:46.721ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85942024-11-14T17:08:46.721ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
85952024-11-14T17:08:46.721ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85962024-11-14T17:08:46.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85972024-11-14T17:08:46.721ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2650, tv_nsec: 449164961 } })
85982024-11-14T17:08:46.721ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
85992024-11-14T17:08:46.721ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2650, tv_nsec: 449596621 } })
86002024-11-14T17:08:46.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86012024-11-14T17:08:46.722ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
86022024-11-14T17:08:46.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.797234ms iteration = 30 status = {"errors":[],"records_set_to_done":[]}
86032024-11-14T17:08:46.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
86042024-11-14T17:08:46.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86052024-11-14T17:08:46.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86062024-11-14T17:08:46.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 97b2b47b-c9f2-480b-87a6-bb14b173e73d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
86072024-11-14T17:08:46.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 97b2b47b-c9f2-480b-87a6-bb14b173e73d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
86082024-11-14T17:08:46.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86092024-11-14T17:08:46.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86102024-11-14T17:08:46.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86112024-11-14T17:08:46.727ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86122024-11-14T17:08:46.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86132024-11-14T17:08:46.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86142024-11-14T17:08:46.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86152024-11-14T17:08:46.728ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86162024-11-14T17:08:46.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86172024-11-14T17:08:46.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86182024-11-14T17:08:46.730ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86192024-11-14T17:08:46.731ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
86202024-11-14T17:08:46.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86212024-11-14T17:08:46.731ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
86222024-11-14T17:08:46.731ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.680557ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
86232024-11-14T17:08:46.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86242024-11-14T17:08:46.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86252024-11-14T17:08:46.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 97b2b47b-c9f2-480b-87a6-bb14b173e73d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
86262024-11-14T17:08:46.732ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86272024-11-14T17:08:46.732ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f70fbf74-7489-439f-8ec3-e6e8473a8b43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2650, tv_nsec: 460646190 } })
86282024-11-14T17:08:46.733ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
86292024-11-14T17:08:46.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86302024-11-14T17:08:46.734ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86312024-11-14T17:08:46.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ab1cf747-839a-49b4-a78c-8ce3eb915ec5, lookup_type: ById(ab1cf747-839a-49b4-a78c-8ce3eb915ec5) } result = Ok(())
86322024-11-14T17:08:46.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86332024-11-14T17:08:46.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86342024-11-14T17:08:46.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86352024-11-14T17:08:46.770ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86362024-11-14T17:08:46.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86372024-11-14T17:08:46.771ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 original_time_created = 2024-11-14 16:54:06.570903 UTC target_id = ab1cf747-839a-49b4-a78c-8ce3eb915ec5 time_created = 2024-11-14 16:54:06.570903 UTC
86382024-11-14T17:08:46.771ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.229272ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ab1cf747-839a-49b4-a78c-8ce3eb915ec5","time_created":"2024-11-14T16:54:06.570903Z"}
86392024-11-14T17:08:46.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.994659ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86402024-11-14T17:08:46.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86412024-11-14T17:08:46.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86422024-11-14T17:08:46.776ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86432024-11-14T17:08:46.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.617368ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
86442024-11-14T17:08:46.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86452024-11-14T17:08:46.778ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.646806ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86462024-11-14T17:08:46.778ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86472024-11-14T17:08:46.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86482024-11-14T17:08:46.780ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 68.924875ms iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
86492024-11-14T17:08:46.781ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86502024-11-14T17:08:46.781ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86512024-11-14T17:08:46.781ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 70.533972ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
86522024-11-14T17:08:46.782ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86532024-11-14T17:08:46.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86542024-11-14T17:08:46.784ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86552024-11-14T17:08:46.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86562024-11-14T17:08:46.788ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86572024-11-14T17:08:46.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f70fbf74-7489-439f-8ec3-e6e8473a8b43, lookup_type: ById(f70fbf74-7489-439f-8ec3-e6e8473a8b43) } result = Ok(())
86582024-11-14T17:08:46.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86592024-11-14T17:08:46.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86602024-11-14T17:08:46.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86612024-11-14T17:08:46.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86622024-11-14T17:08:46.793ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 83.129465ms iteration = 30 status = 0
86632024-11-14T17:08:46.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 92.799014ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
86642024-11-14T17:08:46.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86652024-11-14T17:08:46.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86662024-11-14T17:08:46.808ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86672024-11-14T17:08:46.808ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
86682024-11-14T17:08:46.808ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86692024-11-14T17:08:46.809ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc5201a8-b874-47f7-a10e-e456eb471458", "content-length": "26", "date": "Thu, 14 Nov 2024 17:08:46 GMT"} })
86702024-11-14T17:08:46.809ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86712024-11-14T17:08:46.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86722024-11-14T17:08:46.809ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86732024-11-14T17:08:46.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86742024-11-14T17:08:46.810ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c zone_address = fd00:1122:3344:101::2
86752024-11-14T17:08:46.810ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86762024-11-14T17:08:46.811ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcac90fb-ce76-4906-8e16-1c50c3dac2fb", "content-length": "26", "date": "Thu, 14 Nov 2024 17:08:46 GMT"} })
86772024-11-14T17:08:46.811ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86782024-11-14T17:08:46.811ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86792024-11-14T17:08:46.811ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86802024-11-14T17:08:46.813ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86812024-11-14T17:08:46.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86822024-11-14T17:08:46.813ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
86832024-11-14T17:08:46.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86842024-11-14T17:08:46.824ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
86852024-11-14T17:08:46.824ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86862024-11-14T17:08:46.824ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c66b925c-dd99-474a-844a-454001d0433b", "content-length": "26", "date": "Thu, 14 Nov 2024 17:08:46 GMT"} })
86872024-11-14T17:08:46.824ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86882024-11-14T17:08:46.826ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86892024-11-14T17:08:46.884ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 173.677948ms iteration = 34 status = {"physical_disks_added":0}
86902024-11-14T17:08:46.938ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 227.665116ms iteration = 30 status = {}
86912024-11-14T17:08:46.945ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
86922024-11-14T17:08:46.945ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86932024-11-14T17:08:46.945ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "37f64771-bb44-4d3a-baa1-6a6a2c8cfa52", "content-length": "372", "date": "Thu, 14 Nov 2024 17:08:46 GMT"} })
86942024-11-14T17:08:46.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86952024-11-14T17:08:46.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86962024-11-14T17:08:46.959ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
86972024-11-14T17:08:46.959ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
86982024-11-14T17:08:46.960ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c082585e-2af1-4269-b920-15362cb540c4", "date": "Thu, 14 Nov 2024 17:08:46 GMT"} })
86992024-11-14T17:08:46.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87002024-11-14T17:08:46.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87012024-11-14T17:08:46.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87022024-11-14T17:08:46.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87032024-11-14T17:08:46.963ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
87042024-11-14T17:08:46.963ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bcacf19-cf11-40cb-8402-711a3701f752", "content-length": "2", "date": "Thu, 14 Nov 2024 17:08:46 GMT"} })
87052024-11-14T17:08:46.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87062024-11-14T17:08:46.966ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87072024-11-14T17:08:46.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87082024-11-14T17:08:46.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87092024-11-14T17:08:46.969ZINFOnexus (BackgroundTasks): VPC route manager sled f70fbf74-7489-439f-8ec3-e6e8473a8b43 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
87102024-11-14T17:08:46.969ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87112024-11-14T17:08:46.970ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "edfbd55d-d266-417c-b1ca-b8623527f624", "date": "Thu, 14 Nov 2024 17:08:46 GMT"} })
87122024-11-14T17:08:46.971ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 261.206843ms iteration = 32 status = {}
87132024-11-14T17:08:46.979ZDEBGnexus (BackgroundTasks): client request SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
87142024-11-14T17:08:46.980ZDEBGnexus (BackgroundTasks): client response SledAgent = f70fbf74-7489-439f-8ec3-e6e8473a8b43 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b7afa9c-9a89-493d-b9b4-1d30cc0119a9", "content-length": "691", "date": "Thu, 14 Nov 2024 17:08:46 GMT"} })
87152024-11-14T17:08:46.980ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
87162024-11-14T17:08:46.980ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
87172024-11-14T17:08:46.980ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
87182024-11-14T17:08:46.982ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 271.428204ms iteration = 30 status = null
87192024-11-14T17:08:46.982ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 271.721281ms iteration = 31 status = {}
87202024-11-14T17:08:47.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87212024-11-14T17:08:47.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87222024-11-14T17:08:47.024ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 918a9d80-478e-4992-a5c6-d2e33229f15a, rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(05323398-d6fd-45dd-b92a-227f99cd69e4) } rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
87232024-11-14T17:08:47.024ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87242024-11-14T17:08:47.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87252024-11-14T17:08:47.031ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
87262024-11-14T17:08:47.031ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "52da9770-da47-4625-9905-1d8d2dd3f630", "content-length": "134", "date": "Thu, 14 Nov 2024 17:08:46 GMT"} })
87272024-11-14T17:08:47.031ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
87282024-11-14T17:08:47.031ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 05323398-d6fd-45dd-b92a-227f99cd69e4
87292024-11-14T17:08:47.032ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
87302024-11-14T17:08:47.032ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
87312024-11-14T17:08:47.032ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87322024-11-14T17:08:47.032ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87332024-11-14T17:08:47.032ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87342024-11-14T17:08:47.032ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87352024-11-14T17:08:47.032ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87362024-11-14T17:08:47.032ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87372024-11-14T17:08:47.032ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c
87382024-11-14T17:08:47.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87392024-11-14T17:08:47.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87402024-11-14T17:08:47.034ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
87412024-11-14T17:08:47.034ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2facb54-f7c4-42f1-b56a-ecf0652e86d0", "content-length": "2", "date": "Thu, 14 Nov 2024 17:08:46 GMT"} })
87422024-11-14T17:08:47.034ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
87432024-11-14T17:08:47.034ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d7950a8-a6c5-48eb-84b4-60e69c8bc021", "content-length": "52", "date": "Thu, 14 Nov 2024 17:08:46 GMT"} })
87442024-11-14T17:08:47.034ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch_location = Switch0
87452024-11-14T17:08:47.034ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
87462024-11-14T17:08:47.157ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "be1e2d4a-978f-401f-95b9-0b914311cef9", "date": "Thu, 14 Nov 2024 17:08:47 GMT"} })
87472024-11-14T17:08:47.157ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bea93e92-909d-49e0-be82-54bba0eec36c switch = Switch0
87482024-11-14T17:08:47.157ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bea93e92-909d-49e0-be82-54bba0eec36c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
87492024-11-14T17:08:47.158ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bea93e92-909d-49e0-be82-54bba0eec36c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "04f8f717-12a8-48f0-af62-1b0fa23c629b", "content-length": "682", "date": "Thu, 14 Nov 2024 17:08:47 GMT"} })
87502024-11-14T17:08:47.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87512024-11-14T17:08:47.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87522024-11-14T17:08:47.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87532024-11-14T17:08:47.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87542024-11-14T17:08:47.165ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87552024-11-14T17:08:47.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87562024-11-14T17:08:47.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87572024-11-14T17:08:47.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87582024-11-14T17:08:47.174ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 464.027419ms iteration = 30 status = {}
87592024-11-14T17:08:47.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3d7edfb9-79fc-4a18-bd72-fa464ce48356 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87602024-11-14T17:08:47.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3d7edfb9-79fc-4a18-bd72-fa464ce48356 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87612024-11-14T17:08:47.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 3d7edfb9-79fc-4a18-bd72-fa464ce48356 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87622024-11-14T17:08:48.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 699f804e-2e36-4e1b-94a2-ecf14dbb2c0a roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87632024-11-14T17:08:48.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 699f804e-2e36-4e1b-94a2-ecf14dbb2c0a resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87642024-11-14T17:08:48.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 699f804e-2e36-4e1b-94a2-ecf14dbb2c0a response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87652024-11-14T17:08:49.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cc1e5eeb-09e0-4792-b34a-1fc9fc727806 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87662024-11-14T17:08:49.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cc1e5eeb-09e0-4792-b34a-1fc9fc727806 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87672024-11-14T17:08:49.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = cc1e5eeb-09e0-4792-b34a-1fc9fc727806 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87682024-11-14T17:08:50.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 26d84d91-7221-4552-bee0-1f9bbdc9a632 roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87692024-11-14T17:08:50.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 26d84d91-7221-4552-bee0-1f9bbdc9a632 resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87702024-11-14T17:08:50.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2584 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 26d84d91-7221-4552-bee0-1f9bbdc9a632 response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87712024-11-14T17:08:51.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2155efd7-c1f4-4e48-b1c4-c20212f8bc7d roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87722024-11-14T17:08:51.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2155efd7-c1f4-4e48-b1c4-c20212f8bc7d resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87732024-11-14T17:08:51.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = 2155efd7-c1f4-4e48-b1c4-c20212f8bc7d response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87742024-11-14T17:08:52.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b3213640-598a-4427-a023-ea1f4172aa8c roles = RoleSet { roles: {} } uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87752024-11-14T17:08:52.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b3213640-598a-4427-a023-ea1f4172aa8c resource = Database result = Ok(()) uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43
87762024-11-14T17:08:52.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2656 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57418 req_id = b3213640-598a-4427-a023-ea1f4172aa8c response_code = 200 uri = /probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43