Max level shown:
12024-12-12T04:15:03.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e4cf96c5-3416-4084-88e3-f52d920e1dbb roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
22024-12-12T04:15:03.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e4cf96c5-3416-4084-88e3-f52d920e1dbb resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
32024-12-12T04:15:03.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e4cf96c5-3416-4084-88e3-f52d920e1dbb response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
42024-12-12T04:15:03.659ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
52024-12-12T04:15:03.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62024-12-12T04:15:03.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72024-12-12T04:15:03.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
82024-12-12T04:15:03.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92024-12-12T04:15:03.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102024-12-12T04:15:03.661ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112024-12-12T04:15:03.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122024-12-12T04:15:03.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132024-12-12T04:15:03.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.997228ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
142024-12-12T04:15:03.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
152024-12-12T04:15:03.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
162024-12-12T04:15:03.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
172024-12-12T04:15:03.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
182024-12-12T04:15:03.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
192024-12-12T04:15:03.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
202024-12-12T04:15:03.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
212024-12-12T04:15:03.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
222024-12-12T04:15:03.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
232024-12-12T04:15:03.681ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
242024-12-12T04:15:03.681ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.749019ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
252024-12-12T04:15:03.909ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 839 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = 5ee4cf88-5986-4295-9003-a93ec6eb02ac response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
262024-12-12T04:15:04.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = ad4b0f4d-e193-440f-b0d5-b980d3693fb6 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
272024-12-12T04:15:04.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = ad4b0f4d-e193-440f-b0d5-b980d3693fb6 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
282024-12-12T04:15:04.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = ad4b0f4d-e193-440f-b0d5-b980d3693fb6 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
292024-12-12T04:15:05.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 98421762-0d64-444b-baa6-7d8d9841835b roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
302024-12-12T04:15:05.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 98421762-0d64-444b-baa6-7d8d9841835b resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
312024-12-12T04:15:05.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 98421762-0d64-444b-baa6-7d8d9841835b response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
322024-12-12T04:15:06.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e0e67e16-1516-404a-8ced-9aed2146c459 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
332024-12-12T04:15:06.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e0e67e16-1516-404a-8ced-9aed2146c459 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
342024-12-12T04:15:06.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e0e67e16-1516-404a-8ced-9aed2146c459 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
352024-12-12T04:15:07.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = ab3beef9-9b70-4159-9356-62658da903e5 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
362024-12-12T04:15:07.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = ab3beef9-9b70-4159-9356-62658da903e5 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
372024-12-12T04:15:07.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = ab3beef9-9b70-4159-9356-62658da903e5 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
382024-12-12T04:15:08.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e1057f2a-9b5c-4e9a-bcc5-b69fdb0e7ed2 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
392024-12-12T04:15:08.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e1057f2a-9b5c-4e9a-bcc5-b69fdb0e7ed2 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
402024-12-12T04:15:08.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e1057f2a-9b5c-4e9a-bcc5-b69fdb0e7ed2 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
412024-12-12T04:15:09.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1a95eaa8-ca7b-4321-8669-d27a19e9ebad roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
422024-12-12T04:15:09.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1a95eaa8-ca7b-4321-8669-d27a19e9ebad resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
432024-12-12T04:15:09.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1a95eaa8-ca7b-4321-8669-d27a19e9ebad response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
442024-12-12T04:15:10.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8d63dc36-6cff-4302-99e1-fe1919e3f5a9 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
452024-12-12T04:15:10.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8d63dc36-6cff-4302-99e1-fe1919e3f5a9 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
462024-12-12T04:15:10.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8d63dc36-6cff-4302-99e1-fe1919e3f5a9 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
472024-12-12T04:15:11.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4eede5eb-0a42-4c11-8bd9-34cd6cb50310 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
482024-12-12T04:15:11.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4eede5eb-0a42-4c11-8bd9-34cd6cb50310 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
492024-12-12T04:15:11.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1737 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4eede5eb-0a42-4c11-8bd9-34cd6cb50310 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
502024-12-12T04:15:12.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9372ae19-4b30-49cc-9661-72a0dfd512e9 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
512024-12-12T04:15:12.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9372ae19-4b30-49cc-9661-72a0dfd512e9 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
522024-12-12T04:15:12.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9372ae19-4b30-49cc-9661-72a0dfd512e9 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
532024-12-12T04:15:13.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 41fb3639-a0d4-4b01-b89f-a7cdf3ec4ef5 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
542024-12-12T04:15:13.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 41fb3639-a0d4-4b01-b89f-a7cdf3ec4ef5 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
552024-12-12T04:15:13.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 41fb3639-a0d4-4b01-b89f-a7cdf3ec4ef5 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
562024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
572024-12-12T04:15:13.659ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
582024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
592024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
602024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
612024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
622024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
632024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
642024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
652024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
662024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
672024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
682024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
692024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
702024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
712024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
722024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
732024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
742024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
752024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
762024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
772024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
782024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
792024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
802024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
812024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
822024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
832024-12-12T04:15:13.659ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
842024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
852024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
862024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
872024-12-12T04:15:13.659ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
882024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
892024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
902024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
912024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
922024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
932024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
942024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
952024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
962024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
972024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
982024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
992024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1002024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
1012024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1022024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1032024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
1042024-12-12T04:15:13.660ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-12 04:05:13.660146835 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1052024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
1062024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1072024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
1082024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1092024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1102024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1112024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
1122024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
1132024-12-12T04:15:13.660ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1fe61f23-9928-4fa9-a236-a7026965e207
1142024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1152024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1162024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.33\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"1fe61f23-9928-4fa9-a236-a7026965e207"}
1172024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
1182024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1192024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1202024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
1212024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
1222024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
1232024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1242024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1252024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
1262024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1272024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1282024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1292024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1302024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1312024-12-12T04:15:13.660ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bb732d7-5c6c-418e-9bb4-2b78363c496b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a6e7ea12-5d7a-4497-b4c7-99b34dca3373.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a6e7ea12-5d7a-4497-b4c7-99b34dca3373.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 4346, tv_nsec: 465027051 } })
1322024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1332024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1342024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1352024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1362024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1372024-12-12T04:15:13.660ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("68b92f4b-c208-4567-8395-96046a9b6c9a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c9c9afd6-aa03-4a96-8241-6ae7ccfbce28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d24a9d9f-7884-44e6-bf52-febe49c3b719.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d24a9d9f-7884-44e6-bf52-febe49c3b719.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 4346, tv_nsec: 465247581 } })
1382024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1392024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1402024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1412024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1422024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1432024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1442024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
1452024-12-12T04:15:13.660ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.26171ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
1462024-12-12T04:15:13.661ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
1472024-12-12T04:15:13.661ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 989.231\u{b5}s iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
1482024-12-12T04:15:13.663ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.567291ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1492024-12-12T04:15:13.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1502024-12-12T04:15:13.665ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1512024-12-12T04:15:13.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1522024-12-12T04:15:13.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1532024-12-12T04:15:13.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1542024-12-12T04:15:13.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1552024-12-12T04:15:13.667ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4346, tv_nsec: 472231971 } })
1562024-12-12T04:15:13.667ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
1572024-12-12T04:15:13.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1582024-12-12T04:15:13.669ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1592024-12-12T04:15:13.670ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.720478ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
1602024-12-12T04:15:13.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1612024-12-12T04:15:13.672ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1622024-12-12T04:15:13.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1632024-12-12T04:15:13.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1642024-12-12T04:15:13.673ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1652024-12-12T04:15:13.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1662024-12-12T04:15:13.681ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1672024-12-12T04:15:13.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1682024-12-12T04:15:13.683ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-12 04:05:13.660146835 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1692024-12-12T04:15:13.683ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 23.402338ms iteration = 12 status = {"expiration":"2024-12-12T04:05:13.660146835Z","pruned":[]}
1702024-12-12T04:15:13.684ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1712024-12-12T04:15:13.684ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1722024-12-12T04:15:13.685ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4346, tv_nsec: 490623699 } })
1732024-12-12T04:15:13.686ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
1742024-12-12T04:15:13.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1752024-12-12T04:15:13.687ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1762024-12-12T04:15:13.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1772024-12-12T04:15:13.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1782024-12-12T04:15:13.688ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1792024-12-12T04:15:13.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1802024-12-12T04:15:13.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1812024-12-12T04:15:13.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1822024-12-12T04:15:13.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1832024-12-12T04:15:13.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1842024-12-12T04:15:13.693ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1852024-12-12T04:15:13.693ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1862024-12-12T04:15:13.693ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1872024-12-12T04:15:13.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1882024-12-12T04:15:13.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1892024-12-12T04:15:13.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
1902024-12-12T04:15:13.697ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1912024-12-12T04:15:13.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1922024-12-12T04:15:13.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1932024-12-12T04:15:13.700ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1942024-12-12T04:15:13.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1952024-12-12T04:15:13.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
1962024-12-12T04:15:13.704ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.667223ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
1972024-12-12T04:15:13.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.065873ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
1982024-12-12T04:15:13.708ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1992024-12-12T04:15:13.709ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2002024-12-12T04:15:13.709ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2012024-12-12T04:15:13.709ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2022024-12-12T04:15:13.709ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 49.973067ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2032024-12-12T04:15:13.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2042024-12-12T04:15:13.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2052024-12-12T04:15:13.709ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2062024-12-12T04:15:13.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2072024-12-12T04:15:13.711ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.877859ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2082024-12-12T04:15:13.723ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2092024-12-12T04:15:13.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2102024-12-12T04:15:13.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2112024-12-12T04:15:13.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2122024-12-12T04:15:13.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2132024-12-12T04:15:13.725ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2142024-12-12T04:15:13.725ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2152024-12-12T04:15:13.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2162024-12-12T04:15:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2172024-12-12T04:15:13.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2182024-12-12T04:15:13.728ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2192024-12-12T04:15:13.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2202024-12-12T04:15:13.732ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2212024-12-12T04:15:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2222024-12-12T04:15:13.734ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2232024-12-12T04:15:13.734ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4346, tv_nsec: 539125956 } })
2242024-12-12T04:15:13.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2252024-12-12T04:15:13.734ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2262024-12-12T04:15:13.734ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
2272024-12-12T04:15:13.734ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2282024-12-12T04:15:13.734ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2292024-12-12T04:15:13.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2302024-12-12T04:15:13.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2312024-12-12T04:15:13.735ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2322024-12-12T04:15:13.736ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2332024-12-12T04:15:13.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2342024-12-12T04:15:13.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2352024-12-12T04:15:13.738ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2362024-12-12T04:15:13.738ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2372024-12-12T04:15:13.738ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2382024-12-12T04:15:13.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2392024-12-12T04:15:13.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2402024-12-12T04:15:13.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2412024-12-12T04:15:13.739ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2422024-12-12T04:15:13.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2432024-12-12T04:15:13.739ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2442024-12-12T04:15:13.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2452024-12-12T04:15:13.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2462024-12-12T04:15:13.743ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2472024-12-12T04:15:13.743ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2482024-12-12T04:15:13.743ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2492024-12-12T04:15:13.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2502024-12-12T04:15:13.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2512024-12-12T04:15:13.745ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2522024-12-12T04:15:13.747ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2532024-12-12T04:15:13.747ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2542024-12-12T04:15:13.747ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2552024-12-12T04:15:13.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2562024-12-12T04:15:13.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2572024-12-12T04:15:13.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2582024-12-12T04:15:13.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2592024-12-12T04:15:13.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80af691a-30bb-4399-8524-a68071b516df, lookup_type: ById(80af691a-30bb-4399-8524-a68071b516df) } result = Ok(())
2602024-12-12T04:15:13.750ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2612024-12-12T04:15:13.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2622024-12-12T04:15:13.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
2632024-12-12T04:15:13.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2642024-12-12T04:15:13.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2652024-12-12T04:15:13.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2662024-12-12T04:15:13.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2672024-12-12T04:15:13.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2682024-12-12T04:15:13.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2692024-12-12T04:15:13.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2702024-12-12T04:15:13.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2712024-12-12T04:15:13.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2722024-12-12T04:15:13.762ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2732024-12-12T04:15:13.762ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2742024-12-12T04:15:13.762ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 102.68012ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2752024-12-12T04:15:13.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2762024-12-12T04:15:13.773ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
2772024-12-12T04:15:13.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2782024-12-12T04:15:13.775ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 114.906117ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2792024-12-12T04:15:13.778ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
2802024-12-12T04:15:13.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2812024-12-12T04:15:13.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 125.784647ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
2822024-12-12T04:15:13.786ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2832024-12-12T04:15:13.786ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2842024-12-12T04:15:13.786ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 126.3477ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2852024-12-12T04:15:13.787ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
2862024-12-12T04:15:13.789ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2872024-12-12T04:15:13.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2882024-12-12T04:15:13.795ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 136.104976ms iteration = 26 status = {"physical_disks_added":0}
2892024-12-12T04:15:13.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2902024-12-12T04:15:13.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2912024-12-12T04:15:13.845ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2922024-12-12T04:15:13.845ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2932024-12-12T04:15:13.845ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "64816c84-31ed-47d4-b2cf-7b6deb0c681c", "content-length": "26", "date": "Thu, 12 Dec 2024 04:15:13 GMT"} })
2942024-12-12T04:15:13.845ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2952024-12-12T04:15:13.847ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2962024-12-12T04:15:13.866ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2972024-12-12T04:15:13.866ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2982024-12-12T04:15:13.868ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "007d02e7-4766-47d5-a6f3-5bdc09f0b461", "content-length": "26", "date": "Thu, 12 Dec 2024 04:15:13 GMT"} })
2992024-12-12T04:15:13.868ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3002024-12-12T04:15:13.872ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3012024-12-12T04:15:13.908ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 473 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = bd719c82-2afc-446a-a784-1631385df073 response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
3022024-12-12T04:15:13.973ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
3032024-12-12T04:15:13.990ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/d2120084-d65f-4412-8c07-a4b2832354d4/state
3042024-12-12T04:15:13.992ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 333.10231ms iteration = 23 status = 0
3052024-12-12T04:15:14.057ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e zone_address = fd00:1122:3344:101::2
3062024-12-12T04:15:14.057ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3072024-12-12T04:15:14.058ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d98881a-e32f-4a99-8f63-c2764b3428dd", "content-length": "26", "date": "Thu, 12 Dec 2024 04:15:13 GMT"} })
3082024-12-12T04:15:14.058ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3092024-12-12T04:15:14.060ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
3102024-12-12T04:15:14.084ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
3112024-12-12T04:15:14.085ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0c00e679-62c7-4c5d-b8db-11c6c3beb430", "date": "Thu, 12 Dec 2024 04:15:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3122024-12-12T04:15:14.085ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3132024-12-12T04:15:14.087ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3515a895-b4b9-421e-8486-619a0707c941", "date": "Thu, 12 Dec 2024 04:15:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3142024-12-12T04:15:14.087ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3152024-12-12T04:15:14.089ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3162024-12-12T04:15:14.089ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 429.675112ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
3172024-12-12T04:15:14.120ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3182024-12-12T04:15:14.121ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f97623a-a455-4ba4-9a72-adc15da96122", "content-length": "1", "date": "Thu, 12 Dec 2024 04:15:14 GMT"} })
3192024-12-12T04:15:14.123ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3202024-12-12T04:15:14.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3212024-12-12T04:15:14.133ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3222024-12-12T04:15:14.134ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ae0a4a44-7c4d-4536-8906-5427a59ead43", "date": "Thu, 12 Dec 2024 04:15:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
3232024-12-12T04:15:14.134ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
3242024-12-12T04:15:14.136ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "94fad7ed-1a4c-4b78-a2b2-75cf2657d9f8", "date": "Thu, 12 Dec 2024 04:15:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
3252024-12-12T04:15:14.136ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
3262024-12-12T04:15:14.137ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "49c9962e-1e42-47c7-ba87-db70a8863e1d", "date": "Thu, 12 Dec 2024 04:15:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
3272024-12-12T04:15:14.137ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
3282024-12-12T04:15:14.140ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
3292024-12-12T04:15:14.140ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 480.078438ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
3302024-12-12T04:15:14.163ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3312024-12-12T04:15:14.163ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3322024-12-12T04:15:14.164ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4784a299-0d05-477b-b3e5-51115cb4f11d", "content-length": "585", "date": "Thu, 12 Dec 2024 04:15:13 GMT"} })
3332024-12-12T04:15:14.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3342024-12-12T04:15:14.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3352024-12-12T04:15:14.166ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 505.968062ms iteration = 23 status = {}
3362024-12-12T04:15:14.167ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3372024-12-12T04:15:14.167ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 663b0867-5967-4e70-9e4c-e46bea4389d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3382024-12-12T04:15:14.167ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3392024-12-12T04:15:14.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3402024-12-12T04:15:14.170ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3412024-12-12T04:15:14.170ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3422024-12-12T04:15:14.170ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 511.196088ms iteration = 23 status = null
3432024-12-12T04:15:14.173ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3442024-12-12T04:15:14.173ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3452024-12-12T04:15:14.173ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3462024-12-12T04:15:14.173ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3472024-12-12T04:15:14.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3482024-12-12T04:15:14.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3492024-12-12T04:15:14.179ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
3502024-12-12T04:15:14.179ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 519.789114ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
3512024-12-12T04:15:14.202ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3522024-12-12T04:15:14.202ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3bc9d287-62fd-4054-a086-452fd6ea3148 dns_zone_name = oxide.test found_so_far = 0 version = 2
3532024-12-12T04:15:14.202ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3542024-12-12T04:15:14.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3552024-12-12T04:15:14.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3562024-12-12T04:15:14.206ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 546.680416ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
3572024-12-12T04:15:14.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3582024-12-12T04:15:14.209ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3592024-12-12T04:15:14.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3602024-12-12T04:15:14.212ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 663b0867-5967-4e70-9e4c-e46bea4389d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
3612024-12-12T04:15:14.212ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3622024-12-12T04:15:14.212ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-12 04:04:17.984914 UTC dns_group = internal generation = 1
3632024-12-12T04:15:14.212ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 553.109882ms iteration = 12 status = {"generation":1}
3642024-12-12T04:15:14.225ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {b48a8044-86aa-4806-a0d7-ac26510a9a0d: {10.151.1.175: {7b3d8a48-44ad-4338-9f06-f8800312ec5b}, 10.151.1.176: {7b3d8a48-44ad-4338-9f06-f8800312ec5b}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
3652024-12-12T04:15:14.225ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3662024-12-12T04:15:14.225ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ee9052bd-254d-477a-86f3-c2a248ffafab", "date": "Thu, 12 Dec 2024 04:15:13 GMT"} })
3672024-12-12T04:15:14.226ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3682024-12-12T04:15:14.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3692024-12-12T04:15:14.227ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3702024-12-12T04:15:14.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3712024-12-12T04:15:14.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3722024-12-12T04:15:14.229ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3732024-12-12T04:15:14.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3742024-12-12T04:15:14.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3752024-12-12T04:15:14.232ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-12T04:04:09.118019Z, time_modified: 2024-12-12T04:04:09.118019Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, db_silo: Silo { identity: SiloIdentity { id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T04:04:19.153943Z, time_modified: 2024-12-12T04:04:19.153943Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "f0b8912fb2d95a3478b343431ad55a1239b7666e3e9123bdabc1900b27a1339c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, db_silo: Silo { identity: SiloIdentity { id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T04:04:19.153943Z, time_modified: 2024-12-12T04:04:19.153943Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "f0b8912fb2d95a3478b343431ad55a1239b7666e3e9123bdabc1900b27a1339c" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
3762024-12-12T04:15:14.232ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 572.053637ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"46bdf509-11b9-47c6-9aa0-67e689dc84db","tls_certs":["f0b8912fb2d95a3478b343431ad55a1239b7666e3e9123bdabc1900b27a1339c"]}},"default_endpoint":{"silo_id":"46bdf509-11b9-47c6-9aa0-67e689dc84db","tls_certs":["f0b8912fb2d95a3478b343431ad55a1239b7666e3e9123bdabc1900b27a1339c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3772024-12-12T04:15:14.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3782024-12-12T04:15:14.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3792024-12-12T04:15:14.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3802024-12-12T04:15:14.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3812024-12-12T04:15:14.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3822024-12-12T04:15:14.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3832024-12-12T04:15:14.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3842024-12-12T04:15:14.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3852024-12-12T04:15:14.247ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3862024-12-12T04:15:14.247ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3872024-12-12T04:15:14.247ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3882024-12-12T04:15:14.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3892024-12-12T04:15:14.248ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "62dc30c0-b27b-49eb-b691-47634d663352", "date": "Thu, 12 Dec 2024 04:15:13 GMT"} })
3902024-12-12T04:15:14.251ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 591.798064ms iteration = 23 status = {}
3912024-12-12T04:15:14.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3922024-12-12T04:15:14.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3932024-12-12T04:15:14.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3942024-12-12T04:15:14.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3952024-12-12T04:15:14.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3962024-12-12T04:15:14.254ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3bc9d287-62fd-4054-a086-452fd6ea3148 dns_zone_name = oxide.test found_so_far = 1 version = 2
3972024-12-12T04:15:14.254ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3982024-12-12T04:15:14.254ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-12 04:04:19.219093 UTC dns_group = external generation = 2
3992024-12-12T04:15:14.254ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 593.997604ms iteration = 12 status = {"generation":2}
4002024-12-12T04:15:14.256ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c4635247-5d4b-4f7c-ae5e-b1d4df6bd7b3, rack_id: 1612ec8d-a72c-445a-999f-274daa8c155e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(16ab99da-4da3-4a67-a57e-4d569b0ca16d) } rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0
4012024-12-12T04:15:14.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4022024-12-12T04:15:14.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4032024-12-12T04:15:14.267ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4042024-12-12T04:15:14.268ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1beaa385-d39f-4bfd-8633-2afbc9895c61", "content-length": "134", "date": "Thu, 12 Dec 2024 04:15:14 GMT"} })
4052024-12-12T04:15:14.268ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4062024-12-12T04:15:14.268ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 16ab99da-4da3-4a67-a57e-4d569b0ca16d
4072024-12-12T04:15:14.268ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4082024-12-12T04:15:14.268ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4092024-12-12T04:15:14.268ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4102024-12-12T04:15:14.268ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4112024-12-12T04:15:14.268ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4122024-12-12T04:15:14.268ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4132024-12-12T04:15:14.268ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4142024-12-12T04:15:14.268ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4152024-12-12T04:15:14.269ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
4162024-12-12T04:15:14.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4172024-12-12T04:15:14.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4182024-12-12T04:15:14.271ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4192024-12-12T04:15:14.271ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d1181cc-12b7-4d15-a6a2-d787e17929c2", "content-length": "2", "date": "Thu, 12 Dec 2024 04:15:14 GMT"} })
4202024-12-12T04:15:14.271ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4212024-12-12T04:15:14.271ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a83844e1-aadf-49e9-b15c-4134a8a8560d", "content-length": "52", "date": "Thu, 12 Dec 2024 04:15:14 GMT"} })
4222024-12-12T04:15:14.271ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0
4232024-12-12T04:15:14.271ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4242024-12-12T04:15:14.275ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
4252024-12-12T04:15:14.275ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 615.541502ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4262024-12-12T04:15:14.354ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4272024-12-12T04:15:14.432ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fb18de43-6253-46ed-a3e3-0ad3f1c02864", "date": "Thu, 12 Dec 2024 04:15:13 GMT"} })
4282024-12-12T04:15:14.432ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch = Switch0
4292024-12-12T04:15:14.432ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4302024-12-12T04:15:14.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9faf7ef2-1c1f-410e-ac6c-b8c94553e1fa roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4312024-12-12T04:15:14.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9faf7ef2-1c1f-410e-ac6c-b8c94553e1fa resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4322024-12-12T04:15:14.433ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6b8e991-fb2c-4ea8-80d1-f6d6b5738bbf", "content-length": "811", "date": "Thu, 12 Dec 2024 04:15:14 GMT"} })
4332024-12-12T04:15:14.433ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7bd1b7e-c86f-4fef-8f41-d31a82f84ce2", "content-length": "682", "date": "Thu, 12 Dec 2024 04:15:14 GMT"} })
4342024-12-12T04:15:14.433ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(14274613) }} sled = buskin
4352024-12-12T04:15:14.433ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
4362024-12-12T04:15:14.433ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
4372024-12-12T04:15:14.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4382024-12-12T04:15:14.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4392024-12-12T04:15:14.435ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 776.02445ms iteration = 23 status = {}
4402024-12-12T04:15:14.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9faf7ef2-1c1f-410e-ac6c-b8c94553e1fa response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4412024-12-12T04:15:14.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4422024-12-12T04:15:14.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4432024-12-12T04:15:14.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4442024-12-12T04:15:14.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4452024-12-12T04:15:14.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4462024-12-12T04:15:14.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4472024-12-12T04:15:14.455ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 795.362614ms iteration = 23 status = {}
4482024-12-12T04:15:14.558ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
4492024-12-12T04:15:14.558ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
4502024-12-12T04:15:14.589ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
4512024-12-12T04:15:14.589ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:34807
4522024-12-12T04:15:14.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:34807 req_id = 5faa812b-8421-4627-b218-56e5e9b2966a roles = RoleSet { roles: {} } uri = /metrics/producers
4532024-12-12T04:15:14.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:34807 req_id = 5faa812b-8421-4627-b218-56e5e9b2966a resource = Database result = Ok(()) uri = /metrics/producers
4542024-12-12T04:15:14.635ZINFOnexus: assigned collector to new producer collector_id = 987cdbf0-9703-44d8-809c-7fc661879e56 file = nexus/src/app/oximeter.rs:76 producer_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
4552024-12-12T04:15:14.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45869 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:34807 req_id = 5faa812b-8421-4627-b218-56e5e9b2966a response_code = 201 uri = /metrics/producers
4562024-12-12T04:15:14.635ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "5faa812b-8421-4627-b218-56e5e9b2966a", "content-length": "41", "date": "Thu, 12 Dec 2024 04:15:14 GMT"} })
4572024-12-12T04:15:14.638ZDEBGnexus (producer-registration-task): registered with nexus successfully
4582024-12-12T04:15:14.638ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
4592024-12-12T04:15:15.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5837beae-2a1f-4639-b7ed-7f8ed94e2484 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4602024-12-12T04:15:15.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5837beae-2a1f-4639-b7ed-7f8ed94e2484 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4612024-12-12T04:15:15.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5837beae-2a1f-4639-b7ed-7f8ed94e2484 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4622024-12-12T04:15:16.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a66127bd-bdde-4a72-b63e-b91b54eeaafc roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4632024-12-12T04:15:16.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a66127bd-bdde-4a72-b63e-b91b54eeaafc resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4642024-12-12T04:15:16.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a66127bd-bdde-4a72-b63e-b91b54eeaafc response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4652024-12-12T04:15:17.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3b2b4dfa-16bd-48de-bda3-57514fc63d23 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4662024-12-12T04:15:17.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3b2b4dfa-16bd-48de-bda3-57514fc63d23 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4672024-12-12T04:15:17.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3b2b4dfa-16bd-48de-bda3-57514fc63d23 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4682024-12-12T04:15:18.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 0069fe8a-d36c-425d-90ee-b67dcaf7dfb7 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4692024-12-12T04:15:18.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 0069fe8a-d36c-425d-90ee-b67dcaf7dfb7 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4702024-12-12T04:15:18.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 0069fe8a-d36c-425d-90ee-b67dcaf7dfb7 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4712024-12-12T04:15:19.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 6a354185-7c4f-4768-9dab-c2052030bb14 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4722024-12-12T04:15:19.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 6a354185-7c4f-4768-9dab-c2052030bb14 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4732024-12-12T04:15:19.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 6a354185-7c4f-4768-9dab-c2052030bb14 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4742024-12-12T04:15:20.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4af5dee0-2dd4-4da7-9e40-d49d9579907e roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4752024-12-12T04:15:20.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4af5dee0-2dd4-4da7-9e40-d49d9579907e resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4762024-12-12T04:15:20.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4af5dee0-2dd4-4da7-9e40-d49d9579907e response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4772024-12-12T04:15:20.644ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/d2120084-d65f-4412-8c07-a4b2832354d4/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "8774fed7-8c26-4c9e-a012-830e9aeb9a5a", "content-length": "131", "date": "Thu, 12 Dec 2024 04:15:20 GMT"} })
4782024-12-12T04:15:20.650ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f sled_id = 80af691a-30bb-4399-8524-a68071b516df state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-12T04:15:12.556290649Z }, migration_in: None, migration_out: None } vmm_id = d2120084-d65f-4412-8c07-a4b2832354d4
4792024-12-12T04:15:20.650ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 sled_id = 80af691a-30bb-4399-8524-a68071b516df vmm_id = d2120084-d65f-4412-8c07-a4b2832354d4 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-12T04:15:12.556290649Z }
4802024-12-12T04:15:20.650ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f roles = RoleSet { roles: {} } sled_id = 80af691a-30bb-4399-8524-a68071b516df vmm_id = d2120084-d65f-4412-8c07-a4b2832354d4
4812024-12-12T04:15:20.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f resource = Database result = Ok(()) sled_id = 80af691a-30bb-4399-8524-a68071b516df vmm_id = d2120084-d65f-4412-8c07-a4b2832354d4
4822024-12-12T04:15:20.666ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7c8fffcc-e70c-4d7c-8170-eaa297414e29 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-12T04:15:20.645603542Z }
4832024-12-12T04:15:20.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7c8fffcc-e70c-4d7c-8170-eaa297414e29 roles = RoleSet { roles: {} } uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
4842024-12-12T04:15:20.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7c8fffcc-e70c-4d7c-8170-eaa297414e29 resource = Database result = Ok(()) uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
4852024-12-12T04:15:20.678ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
4862024-12-12T04:15:20.679ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 7.019322821s iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
4872024-12-12T04:15:20.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58071 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7c8fffcc-e70c-4d7c-8170-eaa297414e29 response_code = 204 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
4882024-12-12T04:15:20.706ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a9be4025-dc38-4daa-ba4e-92b5f2ef755d uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-12T04:15:20.706719668Z }
4892024-12-12T04:15:20.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a9be4025-dc38-4daa-ba4e-92b5f2ef755d roles = RoleSet { roles: {} } uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
4902024-12-12T04:15:20.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a9be4025-dc38-4daa-ba4e-92b5f2ef755d resource = Database result = Ok(()) uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
4912024-12-12T04:15:20.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35147 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a9be4025-dc38-4daa-ba4e-92b5f2ef755d response_code = 204 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
4922024-12-12T04:15:21.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 6c88fe20-9696-4828-9973-37cbd0c4d248 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4932024-12-12T04:15:21.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 6c88fe20-9696-4828-9973-37cbd0c4d248 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4942024-12-12T04:15:21.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 6c88fe20-9696-4828-9973-37cbd0c4d248 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4952024-12-12T04:15:22.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 369ab761-2626-4a2e-9a13-eb90f9933abf roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4962024-12-12T04:15:22.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 369ab761-2626-4a2e-9a13-eb90f9933abf resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4972024-12-12T04:15:22.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 369ab761-2626-4a2e-9a13-eb90f9933abf response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4982024-12-12T04:15:23.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 92db0079-495a-424c-bbbb-c819d0635a1a roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
4992024-12-12T04:15:23.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 92db0079-495a-424c-bbbb-c819d0635a1a resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5002024-12-12T04:15:23.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 92db0079-495a-424c-bbbb-c819d0635a1a response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5012024-12-12T04:15:23.659ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
5022024-12-12T04:15:23.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5032024-12-12T04:15:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5042024-12-12T04:15:23.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
5052024-12-12T04:15:23.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5062024-12-12T04:15:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5072024-12-12T04:15:23.689ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5082024-12-12T04:15:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5092024-12-12T04:15:23.690ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5102024-12-12T04:15:23.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5112024-12-12T04:15:23.693ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5122024-12-12T04:15:23.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5132024-12-12T04:15:23.695ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5142024-12-12T04:15:23.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5152024-12-12T04:15:23.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5162024-12-12T04:15:23.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
5172024-12-12T04:15:23.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5182024-12-12T04:15:23.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5192024-12-12T04:15:23.709ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
5202024-12-12T04:15:23.709ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.105302ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
5212024-12-12T04:15:23.720ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.749185ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5222024-12-12T04:15:23.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = cb7bde52-b9cf-42c3-9bec-b0c73aba8621 roles = RoleSet { roles: {} } uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?sort_by=id_ascending
5232024-12-12T04:15:23.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = cb7bde52-b9cf-42c3-9bec-b0c73aba8621 resource = Database result = Ok(()) uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?sort_by=id_ascending
5242024-12-12T04:15:23.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = cb7bde52-b9cf-42c3-9bec-b0c73aba8621 response_code = 200 uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?sort_by=id_ascending
5252024-12-12T04:15:23.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 403ede21-b804-42f7-bdec-1816558f71c0 roles = RoleSet { roles: {} } uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjI0MDkxNy1jZjRiLTQxNWYtOGJkMC0xYTI0MmM1MDUxNmYifX0%3D
5262024-12-12T04:15:23.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 403ede21-b804-42f7-bdec-1816558f71c0 resource = Database result = Ok(()) uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjI0MDkxNy1jZjRiLTQxNWYtOGJkMC0xYTI0MmM1MDUxNmYifX0%3D
5272024-12-12T04:15:23.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 403ede21-b804-42f7-bdec-1816558f71c0 response_code = 200 uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjI0MDkxNy1jZjRiLTQxNWYtOGJkMC0xYTI0MmM1MDUxNmYifX0%3D
5282024-12-12T04:15:23.911ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3021 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = b78eb47e-a016-4aa5-9d43-0b7328ab1863 response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
5292024-12-12T04:15:24.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 01c990f9-6e55-4d1e-ad91-6ebd45e09d1c roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5302024-12-12T04:15:24.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 01c990f9-6e55-4d1e-ad91-6ebd45e09d1c resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5312024-12-12T04:15:24.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 01c990f9-6e55-4d1e-ad91-6ebd45e09d1c response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5322024-12-12T04:15:25.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3360a9a4-8e04-4a05-afd0-be645fd8522c roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5332024-12-12T04:15:25.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3360a9a4-8e04-4a05-afd0-be645fd8522c resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5342024-12-12T04:15:25.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3360a9a4-8e04-4a05-afd0-be645fd8522c response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5352024-12-12T04:15:26.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2fc1934d-25c3-444b-8487-c032ac5dce63 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5362024-12-12T04:15:26.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2fc1934d-25c3-444b-8487-c032ac5dce63 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5372024-12-12T04:15:26.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2fc1934d-25c3-444b-8487-c032ac5dce63 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5382024-12-12T04:15:27.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 07e2c057-0a87-43a3-8437-696fe08a343b roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5392024-12-12T04:15:27.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 07e2c057-0a87-43a3-8437-696fe08a343b resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5402024-12-12T04:15:27.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 07e2c057-0a87-43a3-8437-696fe08a343b response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5412024-12-12T04:15:28.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = c1d2b270-2df6-4620-8856-a97e66213812 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5422024-12-12T04:15:28.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = c1d2b270-2df6-4620-8856-a97e66213812 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5432024-12-12T04:15:28.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1649 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = c1d2b270-2df6-4620-8856-a97e66213812 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5442024-12-12T04:15:29.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 77470e9f-102f-441c-9624-43a5e7a48498 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5452024-12-12T04:15:29.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 77470e9f-102f-441c-9624-43a5e7a48498 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5462024-12-12T04:15:29.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 77470e9f-102f-441c-9624-43a5e7a48498 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5472024-12-12T04:15:30.337ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 86793b02-3444-4326-ae99-5606e61b4514 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-12T04:15:30.336712259Z }
5482024-12-12T04:15:30.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 86793b02-3444-4326-ae99-5606e61b4514 roles = RoleSet { roles: {} } uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5492024-12-12T04:15:30.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 86793b02-3444-4326-ae99-5606e61b4514 resource = Database result = Ok(()) uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5502024-12-12T04:15:30.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7359 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 86793b02-3444-4326-ae99-5606e61b4514 response_code = 204 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5512024-12-12T04:15:30.345ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 remote_addr = [fd00:1122:3344:101::1]:64069 req_id = db9d300d-65d0-4f46-9d3b-808fb63f6392 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(7), time_updated: 2024-12-12T04:15:30.345347294Z }
5522024-12-12T04:15:30.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = db9d300d-65d0-4f46-9d3b-808fb63f6392 roles = RoleSet { roles: {} } uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5532024-12-12T04:15:30.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = db9d300d-65d0-4f46-9d3b-808fb63f6392 resource = Database result = Ok(()) uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5542024-12-12T04:15:30.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7629 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = db9d300d-65d0-4f46-9d3b-808fb63f6392 response_code = 204 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5552024-12-12T04:15:30.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = ebfdc73c-40d3-4ec8-b5ae-2db7e25b9e0a roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5562024-12-12T04:15:30.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = ebfdc73c-40d3-4ec8-b5ae-2db7e25b9e0a resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5572024-12-12T04:15:30.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = ebfdc73c-40d3-4ec8-b5ae-2db7e25b9e0a response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5582024-12-12T04:15:31.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = bcca2ce0-a29d-4c32-877d-9f2206fdccb4 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5592024-12-12T04:15:31.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = bcca2ce0-a29d-4c32-877d-9f2206fdccb4 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5602024-12-12T04:15:31.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = bcca2ce0-a29d-4c32-877d-9f2206fdccb4 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
5612024-12-12T04:15:32.784ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-12-12T04:15:32.784147077Z }
5622024-12-12T04:15:32.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 roles = RoleSet { roles: {} } uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5632024-12-12T04:15:32.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 resource = Database result = Ok(()) uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5642024-12-12T04:15:32.819ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4 vmm_needs_update = true
5652024-12-12T04:15:32.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 roles = RoleSet { roles: {} } uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5662024-12-12T04:15:32.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 resource = Database result = Ok(()) uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5672024-12-12T04:15:32.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 roles = RoleSet { roles: {} } uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5682024-12-12T04:15:32.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 resource = Database result = Ok(()) uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5692024-12-12T04:15:32.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 roles = RoleSet { roles: {} } uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5702024-12-12T04:15:32.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 resource = Database result = Ok(()) uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5712024-12-12T04:15:32.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 roles = RoleSet { roles: {} } uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5722024-12-12T04:15:32.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 resource = Database result = Ok(()) uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5732024-12-12T04:15:32.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 roles = RoleSet { roles: {} } uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5742024-12-12T04:15:32.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 resource = Database result = Ok(()) uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5752024-12-12T04:15:32.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 roles = RoleSet { roles: {} } uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5762024-12-12T04:15:32.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 resource = Database result = Ok(()) uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5772024-12-12T04:15:32.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5782024-12-12T04:15:32.862ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 46bdf509-11b9-47c6-9aa0-67e689dc84db, lookup_type: ById(46bdf509-11b9-47c6-9aa0-67e689dc84db) }, key: 4c90e50e-54d5-401d-99f5-b8095a35e8ac, lookup_type: ById(4c90e50e-54d5-401d-99f5-b8095a35e8ac) }, key: f2240917-cf4b-415f-8bd0-1a242c50516f, lookup_type: ById(f2240917-cf4b-415f-8bd0-1a242c50516f) } result = Ok(()) uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5792024-12-12T04:15:32.876ZINFOnexus (dropshot_internal): starting update saga for f2240917-cf4b-415f-8bd0-1a242c50516f actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-12-12T04:15:32.784147077Z }
5802024-12-12T04:15:32.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92513 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 response_code = 204 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5812024-12-12T04:15:32.876ZDEBGnexus (dropshot_internal): preparing instance-update saga for f2240917-cf4b-415f-8bd0-1a242c50516f... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dbaf5189-3c57-4965-82bc-6cd2d63c0259 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5822024-12-12T04:15:32.876ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update
5832024-12-12T04:15:32.877ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2cd6fd21-9082-4012-8042-792ed3868c76 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-12-12T04:15:32.784147077Z }
5842024-12-12T04:15:32.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2cd6fd21-9082-4012-8042-792ed3868c76 roles = RoleSet { roles: {} } uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5852024-12-12T04:15:32.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2cd6fd21-9082-4012-8042-792ed3868c76 resource = Database result = Ok(()) uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5862024-12-12T04:15:32.879ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"f2240917-cf4b-415f-8bd0-1a242c50516f","lookup_type":{"ById":"f2240917-cf4b-415f-8bd0-1a242c50516f"},"parent":{"key":"4c90e50e-54d5-401d-99f5-b8095a35e8ac","lookup_type":{"ById":"4c90e50e-54d5-401d-99f5-b8095a35e8ac"},"parent":{"key":"46bdf509-11b9-47c6-9aa0-67e689dc84db","lookup_type":{"ById":"46bdf509-11b9-47c6-9aa0-67e689dc84db"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
5872024-12-12T04:15:32.879ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update
5882024-12-12T04:15:32.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6755 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2cd6fd21-9082-4012-8042-792ed3868c76 response_code = 204 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
5892024-12-12T04:15:32.924ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update
5902024-12-12T04:15:32.924ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
5912024-12-12T04:15:32.924ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
5922024-12-12T04:15:32.924ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 4a869a4d-6394-478b-ba99-a357223147da
5932024-12-12T04:15:32.929ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
5942024-12-12T04:15:32.929ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 4a869a4d-6394-478b-ba99-a357223147da
5952024-12-12T04:15:32.932ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
5962024-12-12T04:15:32.932ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 4a869a4d-6394-478b-ba99-a357223147da
5972024-12-12T04:15:32.938ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
5982024-12-12T04:15:32.938ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("65903e1c-3f32-4018-bc9d-97876c74e908")) node_id = 0 saga_id = 4a869a4d-6394-478b-ba99-a357223147da
5992024-12-12T04:15:32.942ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
6002024-12-12T04:15:32.942ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 4a869a4d-6394-478b-ba99-a357223147da
6012024-12-12T04:15:32.960ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update
6022024-12-12T04:15:32.964ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6032024-12-12T04:15:32.965ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6042024-12-12T04:15:32.967ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6052024-12-12T04:15:32.967ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6062024-12-12T04:15:32.968ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6072024-12-12T04:15:32.969ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6082024-12-12T04:15:32.971ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6092024-12-12T04:15:32.971ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6102024-12-12T04:15:32.972ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6112024-12-12T04:15:32.972ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6122024-12-12T04:15:32.974ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6132024-12-12T04:15:32.974ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6142024-12-12T04:15:32.975ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6152024-12-12T04:15:32.978ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 46bdf509-11b9-47c6-9aa0-67e689dc84db, lookup_type: ById(46bdf509-11b9-47c6-9aa0-67e689dc84db) }, key: 4c90e50e-54d5-401d-99f5-b8095a35e8ac, lookup_type: ById(4c90e50e-54d5-401d-99f5-b8095a35e8ac) }, key: f2240917-cf4b-415f-8bd0-1a242c50516f, lookup_type: ById(f2240917-cf4b-415f-8bd0-1a242c50516f) } result = Ok(()) saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6162024-12-12T04:15:32.981ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance updater_id = 65903e1c-3f32-4018-bc9d-97876c74e908
6172024-12-12T04:15:32.981ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6182024-12-12T04:15:32.981ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6192024-12-12T04:15:32.993ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance updater_id = 65903e1c-3f32-4018-bc9d-97876c74e908
6202024-12-12T04:15:32.993ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6212024-12-12T04:15:32.993ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance
6222024-12-12T04:15:32.997ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f locked_gen = Generation(Generation(2)) saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = LockInstance updater_id = 65903e1c-3f32-4018-bc9d-97876c74e908
6232024-12-12T04:15:32.999ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
6242024-12-12T04:15:32.999ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("65903e1c-3f32-4018-bc9d-97876c74e908")}) node_id = 1 saga_id = 4a869a4d-6394-478b-ba99-a357223147da
6252024-12-12T04:15:33.003ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
6262024-12-12T04:15:33.003ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 4a869a4d-6394-478b-ba99-a357223147da
6272024-12-12T04:15:33.016ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6282024-12-12T04:15:33.017ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6292024-12-12T04:15:33.018ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6302024-12-12T04:15:33.018ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6312024-12-12T04:15:33.019ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6322024-12-12T04:15:33.019ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6332024-12-12T04:15:33.020ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6342024-12-12T04:15:33.023ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 46bdf509-11b9-47c6-9aa0-67e689dc84db, lookup_type: ById(46bdf509-11b9-47c6-9aa0-67e689dc84db) }, key: 4c90e50e-54d5-401d-99f5-b8095a35e8ac, lookup_type: ById(4c90e50e-54d5-401d-99f5-b8095a35e8ac) }, key: f2240917-cf4b-415f-8bd0-1a242c50516f, lookup_type: ById(f2240917-cf4b-415f-8bd0-1a242c50516f) } result = Ok(()) saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6352024-12-12T04:15:33.023ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6362024-12-12T04:15:33.023ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6372024-12-12T04:15:33.033ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: d2120084-d65f-4412-8c07-a4b2832354d4, time_created: 2024-12-12T04:15:12.002906Z, time_deleted: None, instance_id: f2240917-cf4b-415f-8bd0-1a242c50516f, sled_id: 80af691a-30bb-4399-8524-a68071b516df, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-12T04:15:32.784147Z, gen: Generation(Generation(9)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-12T04:15:09.939204Z, gen: Generation(Generation(3)), propolis_id: Some(d2120084-d65f-4412-8c07-a4b2832354d4), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(d2120084-d65f-4412-8c07-a4b2832354d4 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-12T04:15:33.033804572Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
6382024-12-12T04:15:33.033ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
6392024-12-12T04:15:33.036ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"f2240917-cf4b-415f-8bd0-1a242c50516f","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"d2120084-d65f-4412-8c07-a4b2832354d4"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"f2240917-cf4b-415f-8bd0-1a242c50516f","lookup_type":{"ById":"f2240917-cf4b-415f-8bd0-1a242c50516f"},"parent":{"key":"4c90e50e-54d5-401d-99f5-b8095a35e8ac","lookup_type":{"ById":"4c90e50e-54d5-401d-99f5-b8095a35e8ac"},"parent":{"key":"46bdf509-11b9-47c6-9aa0-67e689dc84db","lookup_type":{"ById":"46bdf509-11b9-47c6-9aa0-67e689dc84db"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"65903e1c-3f32-4018-bc9d-97876c74e908"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"4c90e50e-54d5-401d-99f5-b8095a35e8ac","ram_diff":1073741824},"destroy_active_vmm":"d2120084-d65f-4412-8c07-a4b2832354d4","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-12T04:15:33.033804572Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
6402024-12-12T04:15:33.036ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
6412024-12-12T04:15:33.040ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
6422024-12-12T04:15:33.040ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
6432024-12-12T04:15:33.040ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
6442024-12-12T04:15:33.040ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
6452024-12-12T04:15:33.043ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
6462024-12-12T04:15:33.043ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
6472024-12-12T04:15:33.047ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
6482024-12-12T04:15:33.047ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
6492024-12-12T04:15:33.050ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
6502024-12-12T04:15:33.050ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("2f5effce-ea7f-43e6-9ae7-f5fe7475adda")) node_id = 0 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
6512024-12-12T04:15:33.054ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
6522024-12-12T04:15:33.054ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
6532024-12-12T04:15:33.061ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f parent_lock = UpdaterLock { updater_id: 65903e1c-3f32-4018-bc9d-97876c74e908, locked_gen: Generation(Generation(2)) } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
6542024-12-12T04:15:33.062ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = BecomeUpdater
6552024-12-12T04:15:33.062ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = BecomeUpdater
6562024-12-12T04:15:33.073ZDEBGnexus (SagaExecutor): inherited lock from 65903e1c-3f32-4018-bc9d-97876c74e908 to 2f5effce-ea7f-43e6-9ae7-f5fe7475adda actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 65903e1c-3f32-4018-bc9d-97876c74e908 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = BecomeUpdater updater_id = 2f5effce-ea7f-43e6-9ae7-f5fe7475adda
6572024-12-12T04:15:33.073ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
6582024-12-12T04:15:33.073ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
6592024-12-12T04:15:33.073ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("2f5effce-ea7f-43e6-9ae7-f5fe7475adda")}) node_id = 1 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
6602024-12-12T04:15:33.077ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
6612024-12-12T04:15:33.077ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
6622024-12-12T04:15:33.081ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
6632024-12-12T04:15:33.081ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
6642024-12-12T04:15:33.085ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
6652024-12-12T04:15:33.085ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
6662024-12-12T04:15:33.088ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
6672024-12-12T04:15:33.090ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f
6682024-12-12T04:15:33.090ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = UpdateNetworkConfig
6692024-12-12T04:15:33.090ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = UpdateNetworkConfig
6702024-12-12T04:15:33.093ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = UpdateNetworkConfig
6712024-12-12T04:15:33.093ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = UpdateNetworkConfig
6722024-12-12T04:15:33.099ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
6732024-12-12T04:15:33.099ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = UpdateNetworkConfig
6742024-12-12T04:15:33.099ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = UpdateNetworkConfig
6752024-12-12T04:15:33.101ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
6762024-12-12T04:15:33.101ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
6772024-12-12T04:15:33.102ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
6782024-12-12T04:15:33.103ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
6792024-12-12T04:15:33.104ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
6802024-12-12T04:15:33.104ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
6812024-12-12T04:15:33.104ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
6822024-12-12T04:15:33.110ZDEBGnexus: notifying dendrite of updates instance_id = Some(f2240917-cf4b-415f-8bd0-1a242c50516f (instance)) switch = switch0
6832024-12-12T04:15:33.111ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4365, tv_nsec: 916048391 } })
6842024-12-12T04:15:33.114ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
6852024-12-12T04:15:33.144ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6862024-12-12T04:15:33.144ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6872024-12-12T04:15:33.144ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "16474832-d949-4868-9e91-5b38034c13bb", "content-length": "26", "date": "Thu, 12 Dec 2024 04:15:33 GMT"} })
6882024-12-12T04:15:33.144ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6892024-12-12T04:15:33.145ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6902024-12-12T04:15:33.174ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
6912024-12-12T04:15:33.174ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cfd7c17-5968-44ae-8e35-635b7980c416", "content-length": "4", "date": "Thu, 12 Dec 2024 04:15:32 GMT"} })
6922024-12-12T04:15:33.176ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
6932024-12-12T04:15:33.176ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
6942024-12-12T04:15:33.181ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
6952024-12-12T04:15:33.181ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
6962024-12-12T04:15:33.185ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = ReleaseVirtualProvisioning
6972024-12-12T04:15:33.185ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = ReleaseVirtualProvisioning
6982024-12-12T04:15:33.198ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-12T04:15:33.188166Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, time_modified: Some(2024-12-12T04:15:33.188166Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 4c90e50e-54d5-401d-99f5-b8095a35e8ac, time_modified: Some(2024-12-12T04:15:33.188166Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
6992024-12-12T04:15:33.198ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7002024-12-12T04:15:33.198ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7012024-12-12T04:15:33.202ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7022024-12-12T04:15:33.202ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7032024-12-12T04:15:33.205ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
7042024-12-12T04:15:33.205ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = UnassignOximeterProducer
7052024-12-12T04:15:33.205ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = UnassignOximeterProducer
7062024-12-12T04:15:33.213ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 987cdbf0-9703-44d8-809c-7fc661879e56 producer_id = f2240917-cf4b-415f-8bd0-1a242c50516f saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
7072024-12-12T04:15:33.213ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = UnassignOximeterProducer
7082024-12-12T04:15:33.213ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = UnassignOximeterProducer
7092024-12-12T04:15:33.248ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = f2240917-cf4b-415f-8bd0-1a242c50516f saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
7102024-12-12T04:15:33.251ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = f2240917-cf4b-415f-8bd0-1a242c50516f saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/f2240917-cf4b-415f-8bd0-1a242c50516f
7112024-12-12T04:15:33.276ZDEBGnexus (SagaExecutor): client response oximeter-collector = f2240917-cf4b-415f-8bd0-1a242c50516f result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/f2240917-cf4b-415f-8bd0-1a242c50516f", status: 204, headers: {"x-request-id": "ccd3f57c-02f8-45c5-862d-fea684f995a2", "date": "Thu, 12 Dec 2024 04:15:33 GMT"} }) saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
7122024-12-12T04:15:33.276ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 987cdbf0-9703-44d8-809c-7fc661879e56 producer_id = f2240917-cf4b-415f-8bd0-1a242c50516f saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
7132024-12-12T04:15:33.277ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7142024-12-12T04:15:33.277ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7152024-12-12T04:15:33.281ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7162024-12-12T04:15:33.281ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7172024-12-12T04:15:33.287ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f lock = UpdaterLock { updater_id: 2f5effce-ea7f-43e6-9ae7-f5fe7475adda, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-12T04:15:33.033804572Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
7182024-12-12T04:15:33.289ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = CommitInstanceUpdates
7192024-12-12T04:15:33.289ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = CommitInstanceUpdates
7202024-12-12T04:15:33.333ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f new_runtime = InstanceRuntimeState { time_updated: 2024-12-12T04:15:33.033804572Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
7212024-12-12T04:15:33.333ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7222024-12-12T04:15:33.333ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7232024-12-12T04:15:33.333ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Signaled
7242024-12-12T04:15:33.333ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Signaled
7252024-12-12T04:15:33.333ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
7262024-12-12T04:15:33.333ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7272024-12-12T04:15:33.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7282024-12-12T04:15:33.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7292024-12-12T04:15:33.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7302024-12-12T04:15:33.336ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7312024-12-12T04:15:33.337ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7322024-12-12T04:15:33.337ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7332024-12-12T04:15:33.337ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7342024-12-12T04:15:33.337ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7352024-12-12T04:15:33.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7362024-12-12T04:15:33.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7372024-12-12T04:15:33.340ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7382024-12-12T04:15:33.340ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("f2240917-cf4b-415f-8bd0-1a242c50516f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("d2120084-d65f-4412-8c07-a4b2832354d4")}) node_id = 7 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7392024-12-12T04:15:33.341ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7402024-12-12T04:15:33.341ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7412024-12-12T04:15:33.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7422024-12-12T04:15:33.344ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7432024-12-12T04:15:33.344ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7442024-12-12T04:15:33.347ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7452024-12-12T04:15:33.347ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7462024-12-12T04:15:33.352ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7472024-12-12T04:15:33.352ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7482024-12-12T04:15:33.355ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
7492024-12-12T04:15:33.355ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = ReleaseSledResources
7502024-12-12T04:15:33.356ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = ReleaseSledResources
7512024-12-12T04:15:33.360ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7522024-12-12T04:15:33.360ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7532024-12-12T04:15:33.364ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7542024-12-12T04:15:33.364ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7552024-12-12T04:15:33.367ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
7562024-12-12T04:15:33.367ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = MarkVmmDeleted
7572024-12-12T04:15:33.367ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = MarkVmmDeleted
7582024-12-12T04:15:33.375ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7592024-12-12T04:15:33.375ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7602024-12-12T04:15:33.378ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7612024-12-12T04:15:33.378ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7622024-12-12T04:15:33.379ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7632024-12-12T04:15:33.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7642024-12-12T04:15:33.381ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7652024-12-12T04:15:33.381ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7662024-12-12T04:15:33.385ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7672024-12-12T04:15:33.385ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7682024-12-12T04:15:33.388ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = ChainSuccessorSaga
7692024-12-12T04:15:33.388ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = ChainSuccessorSaga
7702024-12-12T04:15:33.389ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = ChainSuccessorSaga
7712024-12-12T04:15:33.390ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = ChainSuccessorSaga
7722024-12-12T04:15:33.391ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = ChainSuccessorSaga
7732024-12-12T04:15:33.391ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = ChainSuccessorSaga
7742024-12-12T04:15:33.392ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = ChainSuccessorSaga
7752024-12-12T04:15:33.395ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 46bdf509-11b9-47c6-9aa0-67e689dc84db, lookup_type: ById(46bdf509-11b9-47c6-9aa0-67e689dc84db) }, key: 4c90e50e-54d5-401d-99f5-b8095a35e8ac, lookup_type: ById(4c90e50e-54d5-401d-99f5-b8095a35e8ac) }, key: f2240917-cf4b-415f-8bd0-1a242c50516f, lookup_type: ById(f2240917-cf4b-415f-8bd0-1a242c50516f) } result = Ok(()) saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = ChainSuccessorSaga
7762024-12-12T04:15:33.395ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = ChainSuccessorSaga
7772024-12-12T04:15:33.395ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_node = ChainSuccessorSaga
7782024-12-12T04:15:33.400ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f karmic_state = WillReincarnate needs_reincarnation = false saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update
7792024-12-12T04:15:33.400ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7802024-12-12T04:15:33.400ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7812024-12-12T04:15:33.404ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7822024-12-12T04:15:33.404ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7832024-12-12T04:15:33.407ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7842024-12-12T04:15:33.407ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7852024-12-12T04:15:33.410ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7862024-12-12T04:15:33.410ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb
7872024-12-12T04:15:33.435ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7882024-12-12T04:15:33.435ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7892024-12-12T04:15:33.435ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c092c8f0-eae9-454f-bdbf-4ee2e053c2ae", "content-length": "372", "date": "Thu, 12 Dec 2024 04:15:33 GMT"} })
7902024-12-12T04:15:33.435ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7912024-12-12T04:15:33.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7922024-12-12T04:15:33.474ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7932024-12-12T04:15:33.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7942024-12-12T04:15:33.476ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7952024-12-12T04:15:33.477ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7962024-12-12T04:15:33.477ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7972024-12-12T04:15:33.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7982024-12-12T04:15:33.478ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
7992024-12-12T04:15:33.478ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb saga_name = instance-update saga_result = SagaResult { saga_id: 826d2074-57ec-433d-a3df-8ddb20ad5bfb, saga_log: SagaLog { saga_id: 826d2074-57ec-433d-a3df-8ddb20ad5bfb, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("2f5effce-ea7f-43e6-9ae7-f5fe7475adda")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("2f5effce-ea7f-43e6-9ae7-f5fe7475adda")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("f2240917-cf4b-415f-8bd0-1a242c50516f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("d2120084-d65f-4412-8c07-a4b2832354d4")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("f2240917-cf4b-415f-8bd0-1a242c50516f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("d2120084-d65f-4412-8c07-a4b2832354d4")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("2f5effce-ea7f-43e6-9ae7-f5fe7475adda"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("2f5effce-ea7f-43e6-9ae7-f5fe7475adda")}} }) }
8002024-12-12T04:15:33.478ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 826d2074-57ec-433d-a3df-8ddb20ad5bfb instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update
8012024-12-12T04:15:33.478ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
8022024-12-12T04:15:33.478ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 4a869a4d-6394-478b-ba99-a357223147da
8032024-12-12T04:15:33.478ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
8042024-12-12T04:15:33.478ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8052024-12-12T04:15:33.479ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0309c748-48d6-476c-a031-662574d3d3e9", "date": "Thu, 12 Dec 2024 04:15:33 GMT"} })
8062024-12-12T04:15:33.479ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8072024-12-12T04:15:33.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8082024-12-12T04:15:33.479ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8092024-12-12T04:15:33.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8102024-12-12T04:15:33.481ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8112024-12-12T04:15:33.481ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8122024-12-12T04:15:33.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8132024-12-12T04:15:33.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8142024-12-12T04:15:33.483ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
8152024-12-12T04:15:33.483ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 4a869a4d-6394-478b-ba99-a357223147da
8162024-12-12T04:15:33.485ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8172024-12-12T04:15:33.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8182024-12-12T04:15:33.486ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
8192024-12-12T04:15:33.486ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 4a869a4d-6394-478b-ba99-a357223147da
8202024-12-12T04:15:33.487ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8212024-12-12T04:15:33.487ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8222024-12-12T04:15:33.488ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8f773d78-14f0-4a4e-bfdc-4c70af455ce7", "date": "Thu, 12 Dec 2024 04:15:33 GMT"} })
8232024-12-12T04:15:33.489ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 155.779496ms iteration = 24 status = {}
8242024-12-12T04:15:33.489ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 4a869a4d-6394-478b-ba99-a357223147da sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
8252024-12-12T04:15:33.489ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 4a869a4d-6394-478b-ba99-a357223147da
8262024-12-12T04:15:33.534ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update sec_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
8272024-12-12T04:15:33.534ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 4a869a4d-6394-478b-ba99-a357223147da saga_name = start-instance-update saga_result = SagaResult { saga_id: 4a869a4d-6394-478b-ba99-a357223147da, saga_log: SagaLog { saga_id: 4a869a4d-6394-478b-ba99-a357223147da, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("65903e1c-3f32-4018-bc9d-97876c74e908")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("65903e1c-3f32-4018-bc9d-97876c74e908")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("65903e1c-3f32-4018-bc9d-97876c74e908"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("65903e1c-3f32-4018-bc9d-97876c74e908")}} }) }
8282024-12-12T04:15:33.572ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8292024-12-12T04:15:33.572ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "897915fb-b059-4daa-af43-eea5f48030f2", "content-length": "691", "date": "Thu, 12 Dec 2024 04:15:33 GMT"} })
8302024-12-12T04:15:33.572ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
8312024-12-12T04:15:33.572ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
8322024-12-12T04:15:33.572ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
8332024-12-12T04:15:33.575ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 241.323158ms iteration = 24 status = {}
8342024-12-12T04:15:33.659ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
8352024-12-12T04:15:33.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8362024-12-12T04:15:33.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8372024-12-12T04:15:33.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
8382024-12-12T04:15:33.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8392024-12-12T04:15:33.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8402024-12-12T04:15:33.661ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8412024-12-12T04:15:33.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8422024-12-12T04:15:33.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8432024-12-12T04:15:33.663ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.101867ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8442024-12-12T04:15:33.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8452024-12-12T04:15:33.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8462024-12-12T04:15:33.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8472024-12-12T04:15:33.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8482024-12-12T04:15:33.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8492024-12-12T04:15:33.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8502024-12-12T04:15:33.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
8512024-12-12T04:15:33.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8522024-12-12T04:15:33.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8532024-12-12T04:15:33.679ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
8542024-12-12T04:15:33.679ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.910873ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
8552024-12-12T04:15:33.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 68eb2d23-44c2-4226-9a0a-bcbf6164a792 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8562024-12-12T04:15:33.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 68eb2d23-44c2-4226-9a0a-bcbf6164a792 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8572024-12-12T04:15:33.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 68eb2d23-44c2-4226-9a0a-bcbf6164a792 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8582024-12-12T04:15:33.909ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 678 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = 5f7b5901-4211-462a-b1ab-1363ddbf4fb3 response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
8592024-12-12T04:15:34.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7d9414cc-2ddd-4608-862b-036b43f04484 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8602024-12-12T04:15:34.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7d9414cc-2ddd-4608-862b-036b43f04484 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8612024-12-12T04:15:34.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7d9414cc-2ddd-4608-862b-036b43f04484 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8622024-12-12T04:15:35.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 0e9a535b-71f5-4b10-8bec-9ef87a360dbb roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8632024-12-12T04:15:35.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 0e9a535b-71f5-4b10-8bec-9ef87a360dbb resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8642024-12-12T04:15:35.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 0e9a535b-71f5-4b10-8bec-9ef87a360dbb response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8652024-12-12T04:15:36.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 99749057-6c69-4b5e-8afb-f3ca4162c663 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8662024-12-12T04:15:36.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 99749057-6c69-4b5e-8afb-f3ca4162c663 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8672024-12-12T04:15:36.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 99749057-6c69-4b5e-8afb-f3ca4162c663 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8682024-12-12T04:15:37.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 40635f89-d863-4b76-b725-275f6116caca roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8692024-12-12T04:15:37.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 40635f89-d863-4b76-b725-275f6116caca resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8702024-12-12T04:15:37.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 40635f89-d863-4b76-b725-275f6116caca response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8712024-12-12T04:15:38.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 3fc2b474-6e9d-401a-b588-d3ba8ba7b817 roles = RoleSet { roles: {} } uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?sort_by=id_ascending
8722024-12-12T04:15:38.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 3fc2b474-6e9d-401a-b588-d3ba8ba7b817 resource = Database result = Ok(()) uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?sort_by=id_ascending
8732024-12-12T04:15:38.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 3fc2b474-6e9d-401a-b588-d3ba8ba7b817 response_code = 200 uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?sort_by=id_ascending
8742024-12-12T04:15:38.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 27419e49-0071-47ff-a13e-994401092bdd roles = RoleSet { roles: {} } uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYWFmOWFmNi0xYTg2LTQ5MGUtYjI1Zi02YWUwZWQ0MTkxMjEifX0%3D
8752024-12-12T04:15:38.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 27419e49-0071-47ff-a13e-994401092bdd resource = Database result = Ok(()) uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYWFmOWFmNi0xYTg2LTQ5MGUtYjI1Zi02YWUwZWQ0MTkxMjEifX0%3D
8762024-12-12T04:15:38.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 27419e49-0071-47ff-a13e-994401092bdd response_code = 200 uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYWFmOWFmNi0xYTg2LTQ5MGUtYjI1Zi02YWUwZWQ0MTkxMjEifX0%3D
8772024-12-12T04:15:38.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = cc031140-9dfe-49ff-a204-aa0c96443425 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8782024-12-12T04:15:38.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = cc031140-9dfe-49ff-a204-aa0c96443425 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8792024-12-12T04:15:38.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = cc031140-9dfe-49ff-a204-aa0c96443425 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8802024-12-12T04:15:40.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1c850b35-a3ab-43a9-9b4a-9e3a61c1be1e roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8812024-12-12T04:15:40.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1c850b35-a3ab-43a9-9b4a-9e3a61c1be1e resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8822024-12-12T04:15:40.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1c850b35-a3ab-43a9-9b4a-9e3a61c1be1e response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8832024-12-12T04:15:41.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9da5bf59-052a-475b-b910-72de2e9dbbba roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8842024-12-12T04:15:41.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9da5bf59-052a-475b-b910-72de2e9dbbba resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8852024-12-12T04:15:41.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9da5bf59-052a-475b-b910-72de2e9dbbba response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8862024-12-12T04:15:42.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7e364e98-8080-443e-99a7-f8d8e39d814d roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8872024-12-12T04:15:42.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7e364e98-8080-443e-99a7-f8d8e39d814d resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8882024-12-12T04:15:42.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7e364e98-8080-443e-99a7-f8d8e39d814d response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8892024-12-12T04:15:43.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b8e2c1c2-31ae-4d15-9cab-40b52ecc14b4 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8902024-12-12T04:15:43.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b8e2c1c2-31ae-4d15-9cab-40b52ecc14b4 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8912024-12-12T04:15:43.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b8e2c1c2-31ae-4d15-9cab-40b52ecc14b4 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
8922024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
8932024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
8942024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8952024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8962024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
8972024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
8982024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8992024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9002024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
9012024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
9022024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
9032024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
9042024-12-12T04:15:43.659ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9052024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9062024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
9072024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
9082024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9092024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
9102024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
9112024-12-12T04:15:43.659ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9122024-12-12T04:15:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9132024-12-12T04:15:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9142024-12-12T04:15:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9152024-12-12T04:15:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9162024-12-12T04:15:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9172024-12-12T04:15:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9182024-12-12T04:15:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
9192024-12-12T04:15:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9202024-12-12T04:15:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
9212024-12-12T04:15:43.660ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
9222024-12-12T04:15:43.660ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
9232024-12-12T04:15:43.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9242024-12-12T04:15:43.660ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9252024-12-12T04:15:43.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9262024-12-12T04:15:43.660ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
9272024-12-12T04:15:43.660ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9282024-12-12T04:15:43.661ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
9292024-12-12T04:15:43.661ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9302024-12-12T04:15:43.661ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
9312024-12-12T04:15:43.661ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
9322024-12-12T04:15:43.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9332024-12-12T04:15:43.661ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9342024-12-12T04:15:43.661ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
9352024-12-12T04:15:43.661ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9362024-12-12T04:15:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9372024-12-12T04:15:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9382024-12-12T04:15:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9392024-12-12T04:15:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9402024-12-12T04:15:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9412024-12-12T04:15:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9422024-12-12T04:15:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9432024-12-12T04:15:43.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9442024-12-12T04:15:43.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9452024-12-12T04:15:43.663ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9462024-12-12T04:15:43.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9472024-12-12T04:15:43.663ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.082094ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9482024-12-12T04:15:43.664ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4376, tv_nsec: 469261006 } })
9492024-12-12T04:15:43.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9502024-12-12T04:15:43.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9512024-12-12T04:15:43.664ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
9522024-12-12T04:15:43.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9532024-12-12T04:15:43.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9542024-12-12T04:15:43.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9552024-12-12T04:15:43.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9562024-12-12T04:15:43.667ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.339171ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
9572024-12-12T04:15:43.669ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9582024-12-12T04:15:43.669ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
9592024-12-12T04:15:43.669ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9602024-12-12T04:15:43.669ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4376, tv_nsec: 474480179 } })
9612024-12-12T04:15:43.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9622024-12-12T04:15:43.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9632024-12-12T04:15:43.670ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
9642024-12-12T04:15:43.670ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9652024-12-12T04:15:43.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9662024-12-12T04:15:43.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9672024-12-12T04:15:43.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9682024-12-12T04:15:43.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
9692024-12-12T04:15:43.673ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9702024-12-12T04:15:43.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9712024-12-12T04:15:43.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9722024-12-12T04:15:43.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9732024-12-12T04:15:43.676ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9742024-12-12T04:15:43.676ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
9752024-12-12T04:15:43.676ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9762024-12-12T04:15:43.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9772024-12-12T04:15:43.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9782024-12-12T04:15:43.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9792024-12-12T04:15:43.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9802024-12-12T04:15:43.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
9812024-12-12T04:15:43.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9822024-12-12T04:15:43.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9832024-12-12T04:15:43.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9842024-12-12T04:15:43.700ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 40.781894ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
9852024-12-12T04:15:43.702ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9862024-12-12T04:15:43.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
9872024-12-12T04:15:43.702ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9882024-12-12T04:15:43.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9892024-12-12T04:15:43.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9902024-12-12T04:15:43.706ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9912024-12-12T04:15:43.706ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
9922024-12-12T04:15:43.706ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.836146ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
9932024-12-12T04:15:43.707ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4376, tv_nsec: 511614378 } })
9942024-12-12T04:15:43.707ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
9952024-12-12T04:15:43.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9962024-12-12T04:15:43.708ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9972024-12-12T04:15:43.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9982024-12-12T04:15:43.711ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9992024-12-12T04:15:43.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10002024-12-12T04:15:43.712ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10012024-12-12T04:15:43.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10022024-12-12T04:15:43.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10032024-12-12T04:15:43.713ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10042024-12-12T04:15:43.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10052024-12-12T04:15:43.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10062024-12-12T04:15:43.715ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10072024-12-12T04:15:43.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10082024-12-12T04:15:43.715ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10092024-12-12T04:15:43.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10102024-12-12T04:15:43.717ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10112024-12-12T04:15:43.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10122024-12-12T04:15:43.718ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10132024-12-12T04:15:43.718ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.302473ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10142024-12-12T04:15:43.720ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10152024-12-12T04:15:43.720ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10162024-12-12T04:15:43.720ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 59.554944ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
10172024-12-12T04:15:43.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80af691a-30bb-4399-8524-a68071b516df, lookup_type: ById(80af691a-30bb-4399-8524-a68071b516df) } result = Ok(())
10182024-12-12T04:15:43.721ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10192024-12-12T04:15:43.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10202024-12-12T04:15:43.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10212024-12-12T04:15:43.723ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10222024-12-12T04:15:43.723ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.190565ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
10232024-12-12T04:15:43.723ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.870799ms iteration = 24 status = 0
10242024-12-12T04:15:43.723ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10252024-12-12T04:15:43.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10262024-12-12T04:15:43.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10272024-12-12T04:15:43.735ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10282024-12-12T04:15:43.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10292024-12-12T04:15:43.742ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.471766ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
10302024-12-12T04:15:43.743ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10312024-12-12T04:15:43.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10322024-12-12T04:15:43.746ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 85.269865ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10332024-12-12T04:15:43.749ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
10342024-12-12T04:15:43.749ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10352024-12-12T04:15:43.750ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b18c564-68b3-4154-acdc-8d8217189b8f", "content-length": "26", "date": "Thu, 12 Dec 2024 04:15:43 GMT"} })
10362024-12-12T04:15:43.750ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10372024-12-12T04:15:43.752ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10382024-12-12T04:15:43.790ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
10392024-12-12T04:15:43.790ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10402024-12-12T04:15:43.790ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db944cbd-a8b1-4bbf-b11a-27112738975f", "content-length": "26", "date": "Thu, 12 Dec 2024 04:15:43 GMT"} })
10412024-12-12T04:15:43.790ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10422024-12-12T04:15:43.792ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10432024-12-12T04:15:43.801ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 141.752072ms iteration = 27 status = {"physical_disks_added":0}
10442024-12-12T04:15:43.815ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e zone_address = fd00:1122:3344:101::2
10452024-12-12T04:15:43.815ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10462024-12-12T04:15:43.816ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9afb5ca9-1c1f-40fe-9c16-80d12e31bf27", "content-length": "26", "date": "Thu, 12 Dec 2024 04:15:43 GMT"} })
10472024-12-12T04:15:43.816ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10482024-12-12T04:15:43.817ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
10492024-12-12T04:15:43.909ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 558 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = 7bfe8b77-2d8e-4220-af25-352ffebff9e2 response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
10502024-12-12T04:15:43.909ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 248.900135ms iteration = 24 status = {}
10512024-12-12T04:15:44.013ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
10522024-12-12T04:15:44.013ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10532024-12-12T04:15:44.013ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f4766a7-15b4-4d76-89d5-cd4e16573a8e", "content-length": "372", "date": "Thu, 12 Dec 2024 04:15:44 GMT"} })
10542024-12-12T04:15:44.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10552024-12-12T04:15:44.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10562024-12-12T04:15:44.043ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
10572024-12-12T04:15:44.044ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5127ef5-076f-43fb-8a8c-3362b79b3832", "content-length": "2", "date": "Thu, 12 Dec 2024 04:15:43 GMT"} })
10582024-12-12T04:15:44.045ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10592024-12-12T04:15:44.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10602024-12-12T04:15:44.047ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 386.224451ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
10612024-12-12T04:15:44.048ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 388.639084ms iteration = 24 status = null
10622024-12-12T04:15:44.065ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
10632024-12-12T04:15:44.065ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
10642024-12-12T04:15:44.065ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "688f9c62-f747-4e79-8cd9-5fb063decb7c", "date": "Thu, 12 Dec 2024 04:15:44 GMT"} })
10652024-12-12T04:15:44.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10662024-12-12T04:15:44.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10672024-12-12T04:15:44.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10682024-12-12T04:15:44.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10692024-12-12T04:15:44.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10702024-12-12T04:15:44.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10712024-12-12T04:15:44.075ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
10722024-12-12T04:15:44.075ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10732024-12-12T04:15:44.075ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bbb38246-2356-46b6-a5e7-6ca13f22c04a", "date": "Thu, 12 Dec 2024 04:15:44 GMT"} })
10742024-12-12T04:15:44.077ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 417.2171ms iteration = 25 status = {}
10752024-12-12T04:15:44.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 24d1125d-2c8a-4bdf-b44c-f0d71f9e6a42 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
10762024-12-12T04:15:44.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 24d1125d-2c8a-4bdf-b44c-f0d71f9e6a42 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
10772024-12-12T04:15:44.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 24d1125d-2c8a-4bdf-b44c-f0d71f9e6a42 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
10782024-12-12T04:15:44.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10792024-12-12T04:15:44.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10802024-12-12T04:15:44.108ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10812024-12-12T04:15:44.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10822024-12-12T04:15:44.109ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c4635247-5d4b-4f7c-ae5e-b1d4df6bd7b3, rack_id: 1612ec8d-a72c-445a-999f-274daa8c155e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(16ab99da-4da3-4a67-a57e-4d569b0ca16d) } rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0
10832024-12-12T04:15:44.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10842024-12-12T04:15:44.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10852024-12-12T04:15:44.120ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
10862024-12-12T04:15:44.120ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "11234176-c407-4a7a-aa57-5d75d53c60f8", "content-length": "134", "date": "Thu, 12 Dec 2024 04:15:44 GMT"} })
10872024-12-12T04:15:44.120ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
10882024-12-12T04:15:44.120ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 16ab99da-4da3-4a67-a57e-4d569b0ca16d
10892024-12-12T04:15:44.120ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
10902024-12-12T04:15:44.120ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
10912024-12-12T04:15:44.120ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10922024-12-12T04:15:44.120ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10932024-12-12T04:15:44.120ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10942024-12-12T04:15:44.120ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
10952024-12-12T04:15:44.120ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10962024-12-12T04:15:44.120ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
10972024-12-12T04:15:44.120ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
10982024-12-12T04:15:44.120ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10992024-12-12T04:15:44.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11002024-12-12T04:15:44.123ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11012024-12-12T04:15:44.123ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "643946a4-9200-437b-a5f9-bb5da1fbb2b4", "content-length": "2", "date": "Thu, 12 Dec 2024 04:15:44 GMT"} })
11022024-12-12T04:15:44.123ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11032024-12-12T04:15:44.123ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2d15802-affd-4704-acfa-2efd94475fa1", "content-length": "52", "date": "Thu, 12 Dec 2024 04:15:44 GMT"} })
11042024-12-12T04:15:44.123ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0
11052024-12-12T04:15:44.123ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11062024-12-12T04:15:44.137ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11072024-12-12T04:15:44.138ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11082024-12-12T04:15:44.138ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11092024-12-12T04:15:44.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11102024-12-12T04:15:44.166ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11112024-12-12T04:15:44.168ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11122024-12-12T04:15:44.168ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11132024-12-12T04:15:44.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11142024-12-12T04:15:44.203ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11152024-12-12T04:15:44.211ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ca9148ce-be95-42b8-9109-074a61b1b754", "date": "Thu, 12 Dec 2024 04:15:44 GMT"} })
11162024-12-12T04:15:44.211ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch = Switch0
11172024-12-12T04:15:44.211ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11182024-12-12T04:15:44.211ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b38032e1-a762-4cd6-8f30-e7d6728dea12", "content-length": "691", "date": "Thu, 12 Dec 2024 04:15:44 GMT"} })
11192024-12-12T04:15:44.211ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
11202024-12-12T04:15:44.211ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
11212024-12-12T04:15:44.211ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
11222024-12-12T04:15:44.211ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "07951089-3151-4a3b-b2f2-fdff3318fbb2", "content-length": "682", "date": "Thu, 12 Dec 2024 04:15:44 GMT"} })
11232024-12-12T04:15:44.212ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11242024-12-12T04:15:44.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11252024-12-12T04:15:44.212ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 552.632882ms iteration = 25 status = {}
11262024-12-12T04:15:44.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11272024-12-12T04:15:44.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11282024-12-12T04:15:44.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11292024-12-12T04:15:44.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11302024-12-12T04:15:44.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11312024-12-12T04:15:44.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11322024-12-12T04:15:44.229ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 569.292706ms iteration = 24 status = {}
11332024-12-12T04:15:45.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e37d7620-e154-4791-948f-89ae3e5b9e4e roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11342024-12-12T04:15:45.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e37d7620-e154-4791-948f-89ae3e5b9e4e resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11352024-12-12T04:15:45.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e37d7620-e154-4791-948f-89ae3e5b9e4e response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11362024-12-12T04:15:46.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8e89cb16-db92-4131-a091-7bf7ed9ec98c roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11372024-12-12T04:15:46.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8e89cb16-db92-4131-a091-7bf7ed9ec98c resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11382024-12-12T04:15:46.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8e89cb16-db92-4131-a091-7bf7ed9ec98c response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11392024-12-12T04:15:47.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4c2cc083-6315-4bb9-9902-17a5345ed753 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11402024-12-12T04:15:47.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4c2cc083-6315-4bb9-9902-17a5345ed753 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11412024-12-12T04:15:47.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4c2cc083-6315-4bb9-9902-17a5345ed753 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11422024-12-12T04:15:48.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 513815c3-19c1-457c-bb0a-ef5157536c0a roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11432024-12-12T04:15:48.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 513815c3-19c1-457c-bb0a-ef5157536c0a resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11442024-12-12T04:15:48.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 513815c3-19c1-457c-bb0a-ef5157536c0a response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11452024-12-12T04:15:49.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2a9e58c8-f541-4d9e-aa6b-7ad9d1f653ab roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11462024-12-12T04:15:49.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2a9e58c8-f541-4d9e-aa6b-7ad9d1f653ab resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11472024-12-12T04:15:49.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2a9e58c8-f541-4d9e-aa6b-7ad9d1f653ab response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11482024-12-12T04:15:50.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 52446855-0037-43be-a2e1-4cb91710d5fc roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11492024-12-12T04:15:50.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 52446855-0037-43be-a2e1-4cb91710d5fc resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11502024-12-12T04:15:50.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 52446855-0037-43be-a2e1-4cb91710d5fc response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11512024-12-12T04:15:51.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1783aef3-c5b3-4a06-9228-1de27a303160 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11522024-12-12T04:15:51.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1783aef3-c5b3-4a06-9228-1de27a303160 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11532024-12-12T04:15:51.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1783aef3-c5b3-4a06-9228-1de27a303160 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11542024-12-12T04:15:52.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = bd53a923-edc6-43cf-ada6-7477923e71c1 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11552024-12-12T04:15:52.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = bd53a923-edc6-43cf-ada6-7477923e71c1 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11562024-12-12T04:15:52.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1751 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = bd53a923-edc6-43cf-ada6-7477923e71c1 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11572024-12-12T04:15:53.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 84eb39e4-5723-4e54-b8cd-a9135c8f845b roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11582024-12-12T04:15:53.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 84eb39e4-5723-4e54-b8cd-a9135c8f845b resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11592024-12-12T04:15:53.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 84eb39e4-5723-4e54-b8cd-a9135c8f845b response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11602024-12-12T04:15:53.660ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
11612024-12-12T04:15:53.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11622024-12-12T04:15:53.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11632024-12-12T04:15:53.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
11642024-12-12T04:15:53.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11652024-12-12T04:15:53.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11662024-12-12T04:15:53.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11672024-12-12T04:15:53.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11682024-12-12T04:15:53.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11692024-12-12T04:15:53.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11702024-12-12T04:15:53.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11712024-12-12T04:15:53.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11722024-12-12T04:15:53.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11732024-12-12T04:15:53.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
11742024-12-12T04:15:53.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11752024-12-12T04:15:53.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11762024-12-12T04:15:53.682ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
11772024-12-12T04:15:53.682ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.680026ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
11782024-12-12T04:15:53.689ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11792024-12-12T04:15:53.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11802024-12-12T04:15:53.717ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.348865ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11812024-12-12T04:15:53.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 6ecdd1ed-e7ce-452e-8217-9d1b497f71da roles = RoleSet { roles: {} } uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?sort_by=id_ascending
11822024-12-12T04:15:53.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 6ecdd1ed-e7ce-452e-8217-9d1b497f71da resource = Database result = Ok(()) uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?sort_by=id_ascending
11832024-12-12T04:15:53.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 6ecdd1ed-e7ce-452e-8217-9d1b497f71da response_code = 200 uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?sort_by=id_ascending
11842024-12-12T04:15:53.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = b2b5d0a2-aa39-4ced-9be6-2e99361d2465 roles = RoleSet { roles: {} } uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYWFmOWFmNi0xYTg2LTQ5MGUtYjI1Zi02YWUwZWQ0MTkxMjEifX0%3D
11852024-12-12T04:15:53.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = b2b5d0a2-aa39-4ced-9be6-2e99361d2465 resource = Database result = Ok(()) uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYWFmOWFmNi0xYTg2LTQ5MGUtYjI1Zi02YWUwZWQ0MTkxMjEifX0%3D
11862024-12-12T04:15:53.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = b2b5d0a2-aa39-4ced-9be6-2e99361d2465 response_code = 200 uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYWFmOWFmNi0xYTg2LTQ5MGUtYjI1Zi02YWUwZWQ0MTkxMjEifX0%3D
11872024-12-12T04:15:53.909ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 561 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = 7f04ac4f-d2d5-436a-910a-5a5b386b8264 response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
11882024-12-12T04:15:54.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a8111154-295b-40f7-b0cf-bcd417cd04d4 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11892024-12-12T04:15:54.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a8111154-295b-40f7-b0cf-bcd417cd04d4 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11902024-12-12T04:15:54.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a8111154-295b-40f7-b0cf-bcd417cd04d4 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11912024-12-12T04:15:55.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 097a439a-7749-4652-b038-13017069ed51 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11922024-12-12T04:15:55.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 097a439a-7749-4652-b038-13017069ed51 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11932024-12-12T04:15:55.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 097a439a-7749-4652-b038-13017069ed51 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11942024-12-12T04:15:56.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 315a9118-90ff-49ab-832f-05effb6b6a14 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11952024-12-12T04:15:56.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 315a9118-90ff-49ab-832f-05effb6b6a14 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11962024-12-12T04:15:56.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 315a9118-90ff-49ab-832f-05effb6b6a14 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11972024-12-12T04:15:57.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9cd3b218-37f5-433d-b8e8-8acca96df1e5 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11982024-12-12T04:15:57.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9cd3b218-37f5-433d-b8e8-8acca96df1e5 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
11992024-12-12T04:15:57.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9cd3b218-37f5-433d-b8e8-8acca96df1e5 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12002024-12-12T04:15:58.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a24887e7-a379-4699-9e7e-518eb77f22c1 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12012024-12-12T04:15:58.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a24887e7-a379-4699-9e7e-518eb77f22c1 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12022024-12-12T04:15:58.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a24887e7-a379-4699-9e7e-518eb77f22c1 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12032024-12-12T04:15:59.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b5d620b0-2a84-45ee-9e60-2b15a75434d2 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12042024-12-12T04:15:59.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b5d620b0-2a84-45ee-9e60-2b15a75434d2 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12052024-12-12T04:15:59.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b5d620b0-2a84-45ee-9e60-2b15a75434d2 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12062024-12-12T04:16:00.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = d6ce2f49-1dfc-4acc-ab0a-2e0467daddf2 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12072024-12-12T04:16:00.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = d6ce2f49-1dfc-4acc-ab0a-2e0467daddf2 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12082024-12-12T04:16:00.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = d6ce2f49-1dfc-4acc-ab0a-2e0467daddf2 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12092024-12-12T04:16:01.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5ae4bd0d-10ec-40f4-88d2-0b9e1e64583d roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12102024-12-12T04:16:01.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5ae4bd0d-10ec-40f4-88d2-0b9e1e64583d resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12112024-12-12T04:16:01.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5ae4bd0d-10ec-40f4-88d2-0b9e1e64583d response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12122024-12-12T04:16:02.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e938bd0c-1dce-473d-a835-c607904db6e7 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12132024-12-12T04:16:02.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e938bd0c-1dce-473d-a835-c607904db6e7 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12142024-12-12T04:16:02.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e938bd0c-1dce-473d-a835-c607904db6e7 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12152024-12-12T04:16:03.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 186c7291-b48f-4aca-8564-9c2dbe8669a3 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12162024-12-12T04:16:03.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 186c7291-b48f-4aca-8564-9c2dbe8669a3 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12172024-12-12T04:16:03.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 186c7291-b48f-4aca-8564-9c2dbe8669a3 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12182024-12-12T04:16:03.659ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
12192024-12-12T04:16:03.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12202024-12-12T04:16:03.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12212024-12-12T04:16:03.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
12222024-12-12T04:16:03.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12232024-12-12T04:16:03.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12242024-12-12T04:16:03.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12252024-12-12T04:16:03.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12262024-12-12T04:16:03.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12272024-12-12T04:16:03.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12282024-12-12T04:16:03.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12292024-12-12T04:16:03.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12302024-12-12T04:16:03.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12312024-12-12T04:16:03.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
12322024-12-12T04:16:03.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12332024-12-12T04:16:03.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12342024-12-12T04:16:03.686ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
12352024-12-12T04:16:03.686ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.157495ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
12362024-12-12T04:16:03.695ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12372024-12-12T04:16:03.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12382024-12-12T04:16:03.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.342334ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12392024-12-12T04:16:03.909ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 852 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = 992629ee-1bfd-4a7b-b743-1b530f44c862 response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
12402024-12-12T04:16:04.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b1373348-63e9-4194-a276-ba65f4b457cd roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12412024-12-12T04:16:04.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b1373348-63e9-4194-a276-ba65f4b457cd resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12422024-12-12T04:16:04.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b1373348-63e9-4194-a276-ba65f4b457cd response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12432024-12-12T04:16:05.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e0bbf1bc-0abc-4306-be36-95baf6bdc6bc roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12442024-12-12T04:16:05.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e0bbf1bc-0abc-4306-be36-95baf6bdc6bc resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12452024-12-12T04:16:05.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1818 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e0bbf1bc-0abc-4306-be36-95baf6bdc6bc response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12462024-12-12T04:16:06.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 97a6631e-08cf-4a74-a5cd-0dd86e60e0c1 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12472024-12-12T04:16:06.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 97a6631e-08cf-4a74-a5cd-0dd86e60e0c1 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12482024-12-12T04:16:06.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 97a6631e-08cf-4a74-a5cd-0dd86e60e0c1 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12492024-12-12T04:16:07.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = f7bc0055-78d1-434b-94ee-fe0dc34c15d6 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12502024-12-12T04:16:07.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = f7bc0055-78d1-434b-94ee-fe0dc34c15d6 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12512024-12-12T04:16:07.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = f7bc0055-78d1-434b-94ee-fe0dc34c15d6 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12522024-12-12T04:16:08.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1867e22a-89d9-40b9-92cc-8d0f690b8ce4 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12532024-12-12T04:16:08.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1867e22a-89d9-40b9-92cc-8d0f690b8ce4 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12542024-12-12T04:16:08.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1867e22a-89d9-40b9-92cc-8d0f690b8ce4 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12552024-12-12T04:16:09.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3748de72-6b96-4360-a6dd-6f7ebfadcc49 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12562024-12-12T04:16:09.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3748de72-6b96-4360-a6dd-6f7ebfadcc49 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12572024-12-12T04:16:09.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3748de72-6b96-4360-a6dd-6f7ebfadcc49 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12582024-12-12T04:16:10.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = d5bf5b22-c40e-4307-9ee8-3d16bea9529f roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12592024-12-12T04:16:10.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = d5bf5b22-c40e-4307-9ee8-3d16bea9529f resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12602024-12-12T04:16:10.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = d5bf5b22-c40e-4307-9ee8-3d16bea9529f response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12612024-12-12T04:16:11.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9f8ed0cb-cb68-45cb-8406-08e6152fa912 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12622024-12-12T04:16:11.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9f8ed0cb-cb68-45cb-8406-08e6152fa912 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12632024-12-12T04:16:11.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9f8ed0cb-cb68-45cb-8406-08e6152fa912 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12642024-12-12T04:16:12.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 05c30fa2-c07b-4f06-9fe1-eeaddc4e7759 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12652024-12-12T04:16:12.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 05c30fa2-c07b-4f06-9fe1-eeaddc4e7759 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12662024-12-12T04:16:12.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 05c30fa2-c07b-4f06-9fe1-eeaddc4e7759 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
12672024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
12682024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
12692024-12-12T04:16:13.659ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
12702024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12712024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
12722024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
12732024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12742024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
12752024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
12762024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
12772024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
12782024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
12792024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
12802024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12812024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12822024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
12832024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
12842024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
12852024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
12862024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
12872024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12882024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
12892024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
12902024-12-12T04:16:13.659ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
12912024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
12922024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12932024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12942024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
12952024-12-12T04:16:13.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12962024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
12972024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
12982024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
12992024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13002024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13012024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13022024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
13032024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13042024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
13052024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
13062024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
13072024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
13082024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
13092024-12-12T04:16:13.660ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1fe61f23-9928-4fa9-a236-a7026965e207
13102024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13112024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
13122024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13132024-12-12T04:16:13.660ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-12 04:06:13.660333711 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13142024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13152024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.47\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"1fe61f23-9928-4fa9-a236-a7026965e207"}
13162024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
13172024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13182024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13192024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13202024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13212024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
13222024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
13232024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
13242024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
13252024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
13262024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
13272024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13282024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13292024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13302024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
13312024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13322024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13332024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
13342024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13352024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13362024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13372024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
13382024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
13392024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13402024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13412024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13422024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
13432024-12-12T04:16:13.660ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bb732d7-5c6c-418e-9bb4-2b78363c496b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a6e7ea12-5d7a-4497-b4c7-99b34dca3373.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a6e7ea12-5d7a-4497-b4c7-99b34dca3373.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 4406, tv_nsec: 465066905 } })
13442024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13452024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13462024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13472024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13482024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13492024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13502024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13512024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13522024-12-12T04:16:13.660ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("68b92f4b-c208-4567-8395-96046a9b6c9a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c9c9afd6-aa03-4a96-8241-6ae7ccfbce28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d24a9d9f-7884-44e6-bf52-febe49c3b719.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d24a9d9f-7884-44e6-bf52-febe49c3b719.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 4406, tv_nsec: 465411473 } })
13532024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13542024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
13552024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13562024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13572024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13582024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13592024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13602024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
13612024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
13622024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.170796ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
13632024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13642024-12-12T04:16:13.660ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13652024-12-12T04:16:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13662024-12-12T04:16:13.661ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13672024-12-12T04:16:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13682024-12-12T04:16:13.661ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
13692024-12-12T04:16:13.661ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 967.603\u{b5}s iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
13702024-12-12T04:16:13.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13712024-12-12T04:16:13.662ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13722024-12-12T04:16:13.663ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13732024-12-12T04:16:13.664ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.416537ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
13742024-12-12T04:16:13.664ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.661872ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
13752024-12-12T04:16:13.664ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13762024-12-12T04:16:13.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13772024-12-12T04:16:13.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13782024-12-12T04:16:13.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13792024-12-12T04:16:13.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
13802024-12-12T04:16:13.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13812024-12-12T04:16:13.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13822024-12-12T04:16:13.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13832024-12-12T04:16:13.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
13842024-12-12T04:16:13.665ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13852024-12-12T04:16:13.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
13862024-12-12T04:16:13.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13872024-12-12T04:16:13.668ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13882024-12-12T04:16:13.668ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13892024-12-12T04:16:13.668ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13902024-12-12T04:16:13.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13912024-12-12T04:16:13.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.012035ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
13922024-12-12T04:16:13.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13932024-12-12T04:16:13.669ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13942024-12-12T04:16:13.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13952024-12-12T04:16:13.670ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4406, tv_nsec: 475024067 } })
13962024-12-12T04:16:13.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13972024-12-12T04:16:13.670ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
13982024-12-12T04:16:13.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13992024-12-12T04:16:13.673ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14002024-12-12T04:16:13.673ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14012024-12-12T04:16:13.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14022024-12-12T04:16:13.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14032024-12-12T04:16:13.675ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14042024-12-12T04:16:13.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14052024-12-12T04:16:13.677ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14062024-12-12T04:16:13.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14072024-12-12T04:16:13.679ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4406, tv_nsec: 483926102 } })
14082024-12-12T04:16:13.679ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
14092024-12-12T04:16:13.679ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-12 04:06:13.660333711 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14102024-12-12T04:16:13.679ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.479286ms iteration = 13 status = {"expiration":"2024-12-12T04:06:13.660333711Z","pruned":[]}
14112024-12-12T04:16:13.681ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14122024-12-12T04:16:13.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14132024-12-12T04:16:13.682ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4406, tv_nsec: 486948860 } })
14142024-12-12T04:16:13.682ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
14152024-12-12T04:16:13.683ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14162024-12-12T04:16:13.685ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14172024-12-12T04:16:13.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14182024-12-12T04:16:13.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14192024-12-12T04:16:13.712ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14202024-12-12T04:16:13.712ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14212024-12-12T04:16:13.712ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14222024-12-12T04:16:13.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14232024-12-12T04:16:13.713ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
14242024-12-12T04:16:13.713ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
14252024-12-12T04:16:13.713ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 53.404301ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
14262024-12-12T04:16:13.713ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14272024-12-12T04:16:13.713ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14282024-12-12T04:16:13.714ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14292024-12-12T04:16:13.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14302024-12-12T04:16:13.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14312024-12-12T04:16:13.715ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.419008ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
14322024-12-12T04:16:13.715ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14332024-12-12T04:16:13.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14342024-12-12T04:16:13.716ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14352024-12-12T04:16:13.716ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14362024-12-12T04:16:13.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14372024-12-12T04:16:13.717ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14382024-12-12T04:16:13.718ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14392024-12-12T04:16:13.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14402024-12-12T04:16:13.718ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14412024-12-12T04:16:13.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14422024-12-12T04:16:13.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14432024-12-12T04:16:13.722ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14442024-12-12T04:16:13.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14452024-12-12T04:16:13.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14462024-12-12T04:16:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14472024-12-12T04:16:13.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14482024-12-12T04:16:13.726ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14492024-12-12T04:16:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14502024-12-12T04:16:13.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9deeaf9b-70e7-4cb6-9f21-4089e7acc4d0 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
14512024-12-12T04:16:13.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9deeaf9b-70e7-4cb6-9f21-4089e7acc4d0 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
14522024-12-12T04:16:13.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14532024-12-12T04:16:13.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.615542ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14542024-12-12T04:16:13.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14552024-12-12T04:16:13.728ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14562024-12-12T04:16:13.728ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14572024-12-12T04:16:13.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14582024-12-12T04:16:13.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.40001ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14592024-12-12T04:16:13.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14602024-12-12T04:16:13.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14612024-12-12T04:16:13.729ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14622024-12-12T04:16:13.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14632024-12-12T04:16:13.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14642024-12-12T04:16:13.730ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14652024-12-12T04:16:13.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14662024-12-12T04:16:13.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14672024-12-12T04:16:13.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14682024-12-12T04:16:13.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14692024-12-12T04:16:13.731ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
14702024-12-12T04:16:13.731ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
14712024-12-12T04:16:13.731ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.034577ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
14722024-12-12T04:16:13.732ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14732024-12-12T04:16:13.732ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14742024-12-12T04:16:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14752024-12-12T04:16:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14762024-12-12T04:16:13.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9deeaf9b-70e7-4cb6-9f21-4089e7acc4d0 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
14772024-12-12T04:16:13.734ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 75.165202ms iteration = 6 status = {"nsuccess":5}
14782024-12-12T04:16:13.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14792024-12-12T04:16:13.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14802024-12-12T04:16:13.736ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14812024-12-12T04:16:13.736ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14822024-12-12T04:16:13.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14832024-12-12T04:16:13.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14842024-12-12T04:16:13.738ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14852024-12-12T04:16:13.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
14862024-12-12T04:16:13.739ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14872024-12-12T04:16:13.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14882024-12-12T04:16:13.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
14892024-12-12T04:16:13.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14902024-12-12T04:16:13.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14912024-12-12T04:16:13.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14922024-12-12T04:16:13.750ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14932024-12-12T04:16:13.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14942024-12-12T04:16:13.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.556087ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
14952024-12-12T04:16:13.764ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
14962024-12-12T04:16:13.765ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
14972024-12-12T04:16:13.765ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
14982024-12-12T04:16:13.765ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14992024-12-12T04:16:13.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15002024-12-12T04:16:13.766ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15012024-12-12T04:16:13.767ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
15022024-12-12T04:16:13.767ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 106.737098ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
15032024-12-12T04:16:13.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15042024-12-12T04:16:13.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15052024-12-12T04:16:13.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15062024-12-12T04:16:13.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15072024-12-12T04:16:13.768ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15082024-12-12T04:16:13.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15092024-12-12T04:16:13.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15102024-12-12T04:16:13.770ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15112024-12-12T04:16:13.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15122024-12-12T04:16:13.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15132024-12-12T04:16:13.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15142024-12-12T04:16:13.774ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15152024-12-12T04:16:13.775ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 114.94975ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
15162024-12-12T04:16:13.776ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
15172024-12-12T04:16:13.776ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
15182024-12-12T04:16:13.776ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
15192024-12-12T04:16:13.776ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15202024-12-12T04:16:13.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15212024-12-12T04:16:13.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80af691a-30bb-4399-8524-a68071b516df, lookup_type: ById(80af691a-30bb-4399-8524-a68071b516df) } result = Ok(())
15222024-12-12T04:16:13.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15232024-12-12T04:16:13.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15242024-12-12T04:16:13.777ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15252024-12-12T04:16:13.777ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15262024-12-12T04:16:13.777ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 117.221359ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15272024-12-12T04:16:13.778ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15282024-12-12T04:16:13.778ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 118.089664ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15292024-12-12T04:16:13.778ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15302024-12-12T04:16:13.779ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 119.213974ms iteration = 25 status = 0
15312024-12-12T04:16:13.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15322024-12-12T04:16:13.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15332024-12-12T04:16:13.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15342024-12-12T04:16:13.786ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15352024-12-12T04:16:13.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15362024-12-12T04:16:13.787ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15372024-12-12T04:16:13.789ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15382024-12-12T04:16:13.789ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15392024-12-12T04:16:13.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15402024-12-12T04:16:13.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15412024-12-12T04:16:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15422024-12-12T04:16:13.803ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
15432024-12-12T04:16:13.803ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3bc9d287-62fd-4054-a086-452fd6ea3148 dns_zone_name = oxide.test found_so_far = 0 version = 2
15442024-12-12T04:16:13.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15452024-12-12T04:16:13.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15462024-12-12T04:16:13.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15472024-12-12T04:16:13.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15482024-12-12T04:16:13.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15492024-12-12T04:16:13.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15502024-12-12T04:16:13.815ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3bc9d287-62fd-4054-a086-452fd6ea3148 dns_zone_name = oxide.test found_so_far = 1 version = 2
15512024-12-12T04:16:13.815ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
15522024-12-12T04:16:13.815ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-12 04:04:19.219093 UTC dns_group = external generation = 2
15532024-12-12T04:16:13.815ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 155.18124ms iteration = 13 status = {"generation":2}
15542024-12-12T04:16:13.819ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
15552024-12-12T04:16:13.819ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 663b0867-5967-4e70-9e4c-e46bea4389d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
15562024-12-12T04:16:13.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15572024-12-12T04:16:13.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15582024-12-12T04:16:13.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15592024-12-12T04:16:13.820ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e zone_address = fd00:1122:3344:101::2
15602024-12-12T04:16:13.820ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15612024-12-12T04:16:13.821ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e01a5ec9-8779-4b30-bf55-3b62226fd7c2", "content-length": "26", "date": "Thu, 12 Dec 2024 04:16:12 GMT"} })
15622024-12-12T04:16:13.821ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15632024-12-12T04:16:13.823ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
15642024-12-12T04:16:13.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15652024-12-12T04:16:13.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15662024-12-12T04:16:13.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15672024-12-12T04:16:13.826ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15682024-12-12T04:16:13.826ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15692024-12-12T04:16:13.826ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 663b0867-5967-4e70-9e4c-e46bea4389d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
15702024-12-12T04:16:13.826ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
15712024-12-12T04:16:13.826ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-12 04:04:17.984914 UTC dns_group = internal generation = 1
15722024-12-12T04:16:13.826ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 166.632319ms iteration = 13 status = {"generation":1}
15732024-12-12T04:16:13.826ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "86566a25-c6d7-4fb3-803d-d36ac66a9395", "content-length": "26", "date": "Thu, 12 Dec 2024 04:16:12 GMT"} })
15742024-12-12T04:16:13.826ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15752024-12-12T04:16:13.828ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15762024-12-12T04:16:13.832ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-12T04:04:09.118019Z, time_modified: 2024-12-12T04:04:09.118019Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, db_silo: Silo { identity: SiloIdentity { id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T04:04:19.153943Z, time_modified: 2024-12-12T04:04:19.153943Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "f0b8912fb2d95a3478b343431ad55a1239b7666e3e9123bdabc1900b27a1339c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, db_silo: Silo { identity: SiloIdentity { id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T04:04:19.153943Z, time_modified: 2024-12-12T04:04:19.153943Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "f0b8912fb2d95a3478b343431ad55a1239b7666e3e9123bdabc1900b27a1339c" }] }) }
15772024-12-12T04:16:13.832ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 171.864187ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"46bdf509-11b9-47c6-9aa0-67e689dc84db","tls_certs":["f0b8912fb2d95a3478b343431ad55a1239b7666e3e9123bdabc1900b27a1339c"]}},"default_endpoint":{"silo_id":"46bdf509-11b9-47c6-9aa0-67e689dc84db","tls_certs":["f0b8912fb2d95a3478b343431ad55a1239b7666e3e9123bdabc1900b27a1339c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
15782024-12-12T04:16:13.846ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
15792024-12-12T04:16:13.846ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 186.2181ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
15802024-12-12T04:16:13.849ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15812024-12-12T04:16:13.849ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15822024-12-12T04:16:13.849ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "559faeeb-79f7-4fcb-90ca-f9ca98d1f39c", "content-length": "26", "date": "Thu, 12 Dec 2024 04:16:13 GMT"} })
15832024-12-12T04:16:13.849ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15842024-12-12T04:16:13.851ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15852024-12-12T04:16:13.864ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 204.938149ms iteration = 28 status = {"physical_disks_added":0}
15862024-12-12T04:16:13.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15872024-12-12T04:16:13.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15882024-12-12T04:16:13.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15892024-12-12T04:16:13.896ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15902024-12-12T04:16:13.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15912024-12-12T04:16:13.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15922024-12-12T04:16:13.909ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 525 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = 8ad778c3-aaca-4012-87f3-bcdd4a130df0 response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
15932024-12-12T04:16:13.942ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15942024-12-12T04:16:13.963ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
15952024-12-12T04:16:14.020ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
15962024-12-12T04:16:14.020ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9e24971-65d5-49d5-b9ed-4210d6917659", "content-length": "2", "date": "Thu, 12 Dec 2024 04:16:14 GMT"} })
15972024-12-12T04:16:14.023ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15982024-12-12T04:16:14.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15992024-12-12T04:16:14.075ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16002024-12-12T04:16:14.075ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16012024-12-12T04:16:14.075ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "291c4b00-6a8a-4079-901b-93f5c8889d89", "content-length": "372", "date": "Thu, 12 Dec 2024 04:16:13 GMT"} })
16022024-12-12T04:16:14.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16032024-12-12T04:16:14.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16042024-12-12T04:16:14.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16052024-12-12T04:16:14.077ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 417.547208ms iteration = 25 status = null
16062024-12-12T04:16:14.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16072024-12-12T04:16:14.078ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16082024-12-12T04:16:14.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16092024-12-12T04:16:14.125ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
16102024-12-12T04:16:14.125ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16112024-12-12T04:16:14.125ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "de06c9b6-84fd-49af-8322-e8da05138655", "date": "Thu, 12 Dec 2024 04:16:13 GMT"} })
16122024-12-12T04:16:14.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16132024-12-12T04:16:14.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16142024-12-12T04:16:14.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16152024-12-12T04:16:14.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16162024-12-12T04:16:14.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16172024-12-12T04:16:14.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16182024-12-12T04:16:14.135ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16192024-12-12T04:16:14.135ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16202024-12-12T04:16:14.136ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2558c511-6caf-45cb-8c12-e7f998431386", "date": "Thu, 12 Dec 2024 04:16:13 GMT"} })
16212024-12-12T04:16:14.137ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 477.850188ms iteration = 26 status = {}
16222024-12-12T04:16:14.149ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 488.829833ms iteration = 25 status = {}
16232024-12-12T04:16:14.225ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
16242024-12-12T04:16:14.225ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e6729479-767c-49c3-b530-eb98a5e67171", "date": "Thu, 12 Dec 2024 04:16:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16252024-12-12T04:16:14.225ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16262024-12-12T04:16:14.227ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "697e05fa-1a69-488a-b1d2-40153c4c4fa8", "date": "Thu, 12 Dec 2024 04:16:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16272024-12-12T04:16:14.227ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16282024-12-12T04:16:14.229ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16292024-12-12T04:16:14.229ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 569.78158ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16302024-12-12T04:16:14.234ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
16312024-12-12T04:16:14.238ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16322024-12-12T04:16:14.238ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcb120f8-5477-4c00-96ef-c277c7816fc4", "content-length": "691", "date": "Thu, 12 Dec 2024 04:16:13 GMT"} })
16332024-12-12T04:16:14.238ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
16342024-12-12T04:16:14.238ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
16352024-12-12T04:16:14.238ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
16362024-12-12T04:16:14.239ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 580.118741ms iteration = 26 status = {}
16372024-12-12T04:16:14.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16382024-12-12T04:16:14.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16392024-12-12T04:16:14.243ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c4635247-5d4b-4f7c-ae5e-b1d4df6bd7b3, rack_id: 1612ec8d-a72c-445a-999f-274daa8c155e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(16ab99da-4da3-4a67-a57e-4d569b0ca16d) } rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0
16402024-12-12T04:16:14.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16412024-12-12T04:16:14.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16422024-12-12T04:16:14.252ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16432024-12-12T04:16:14.253ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b93d524d-2da6-43c9-b115-3fed5f18ede8", "content-length": "134", "date": "Thu, 12 Dec 2024 04:16:14 GMT"} })
16442024-12-12T04:16:14.253ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
16452024-12-12T04:16:14.253ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 16ab99da-4da3-4a67-a57e-4d569b0ca16d
16462024-12-12T04:16:14.253ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16472024-12-12T04:16:14.253ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16482024-12-12T04:16:14.253ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16492024-12-12T04:16:14.253ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16502024-12-12T04:16:14.253ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16512024-12-12T04:16:14.253ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16522024-12-12T04:16:14.253ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16532024-12-12T04:16:14.253ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16542024-12-12T04:16:14.253ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
16552024-12-12T04:16:14.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16562024-12-12T04:16:14.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16572024-12-12T04:16:14.255ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16582024-12-12T04:16:14.255ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba9a979b-304e-48b8-8d10-52cff8230d96", "content-length": "2", "date": "Thu, 12 Dec 2024 04:16:14 GMT"} })
16592024-12-12T04:16:14.255ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16602024-12-12T04:16:14.255ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "21b21496-f452-48dd-9ed4-02006baf4859", "content-length": "52", "date": "Thu, 12 Dec 2024 04:16:14 GMT"} })
16612024-12-12T04:16:14.255ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0
16622024-12-12T04:16:14.255ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16632024-12-12T04:16:14.268ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16642024-12-12T04:16:14.269ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b1054325-708e-4934-84bd-fca37f7bdf67", "date": "Thu, 12 Dec 2024 04:16:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16652024-12-12T04:16:14.269ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16662024-12-12T04:16:14.270ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4c3a5461-1e52-47fe-98b4-e162c3c7c78c", "date": "Thu, 12 Dec 2024 04:16:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16672024-12-12T04:16:14.270ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16682024-12-12T04:16:14.272ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "12b99443-9d2b-4a2b-9986-1341c886b777", "date": "Thu, 12 Dec 2024 04:16:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16692024-12-12T04:16:14.272ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16702024-12-12T04:16:14.274ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16712024-12-12T04:16:14.274ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 614.123117ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16722024-12-12T04:16:14.342ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4d1305f2-7096-4f9e-a8c9-b3c94ca1ebf1", "date": "Thu, 12 Dec 2024 04:16:13 GMT"} })
16732024-12-12T04:16:14.342ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch = Switch0
16742024-12-12T04:16:14.342ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16752024-12-12T04:16:14.342ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "89494133-b61b-4b63-885b-d87c1616fe21", "content-length": "682", "date": "Thu, 12 Dec 2024 04:16:13 GMT"} })
16762024-12-12T04:16:14.342ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16772024-12-12T04:16:14.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16782024-12-12T04:16:14.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16792024-12-12T04:16:14.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16802024-12-12T04:16:14.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16812024-12-12T04:16:14.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16822024-12-12T04:16:14.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16832024-12-12T04:16:14.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16842024-12-12T04:16:14.359ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 700.014889ms iteration = 25 status = {}
16852024-12-12T04:16:14.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b201f2df-e087-411d-b0df-c08902c39066 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
16862024-12-12T04:16:14.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b201f2df-e087-411d-b0df-c08902c39066 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
16872024-12-12T04:16:14.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b201f2df-e087-411d-b0df-c08902c39066 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
16882024-12-12T04:16:15.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 0734807a-e56c-46cb-8583-a0400b41b0ea roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
16892024-12-12T04:16:15.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 0734807a-e56c-46cb-8583-a0400b41b0ea resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
16902024-12-12T04:16:15.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 0734807a-e56c-46cb-8583-a0400b41b0ea response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
16912024-12-12T04:16:16.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8f07a032-ecde-467a-94bc-61309ec08b82 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
16922024-12-12T04:16:16.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8f07a032-ecde-467a-94bc-61309ec08b82 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
16932024-12-12T04:16:16.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8f07a032-ecde-467a-94bc-61309ec08b82 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
16942024-12-12T04:16:17.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b3166a93-d9c4-45fe-b437-d29a3c4dcb88 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
16952024-12-12T04:16:17.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b3166a93-d9c4-45fe-b437-d29a3c4dcb88 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
16962024-12-12T04:16:17.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b3166a93-d9c4-45fe-b437-d29a3c4dcb88 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
16972024-12-12T04:16:18.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 17fed24e-374b-4645-b116-60d3282a631a roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
16982024-12-12T04:16:18.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 17fed24e-374b-4645-b116-60d3282a631a resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
16992024-12-12T04:16:18.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 17fed24e-374b-4645-b116-60d3282a631a response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17002024-12-12T04:16:19.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 335efc5b-fbcd-4737-a7b2-87beefaea448 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17012024-12-12T04:16:19.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 335efc5b-fbcd-4737-a7b2-87beefaea448 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17022024-12-12T04:16:19.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 335efc5b-fbcd-4737-a7b2-87beefaea448 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17032024-12-12T04:16:20.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = f3a54291-7d45-4f88-869b-e8af5753bcfa roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17042024-12-12T04:16:20.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = f3a54291-7d45-4f88-869b-e8af5753bcfa resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17052024-12-12T04:16:20.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = f3a54291-7d45-4f88-869b-e8af5753bcfa response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17062024-12-12T04:16:21.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5df9e8ae-6b2f-45e5-96c2-d45651ba00b0 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17072024-12-12T04:16:21.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5df9e8ae-6b2f-45e5-96c2-d45651ba00b0 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17082024-12-12T04:16:21.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5df9e8ae-6b2f-45e5-96c2-d45651ba00b0 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17092024-12-12T04:16:23.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 57784de1-0c3f-44c1-82dd-f69d252d2de7 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17102024-12-12T04:16:23.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 57784de1-0c3f-44c1-82dd-f69d252d2de7 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17112024-12-12T04:16:23.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 57784de1-0c3f-44c1-82dd-f69d252d2de7 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17122024-12-12T04:16:23.659ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
17132024-12-12T04:16:23.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17142024-12-12T04:16:23.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17152024-12-12T04:16:23.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
17162024-12-12T04:16:23.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17172024-12-12T04:16:23.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17182024-12-12T04:16:23.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17192024-12-12T04:16:23.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17202024-12-12T04:16:23.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17212024-12-12T04:16:23.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17222024-12-12T04:16:23.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17232024-12-12T04:16:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17242024-12-12T04:16:23.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17252024-12-12T04:16:23.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
17262024-12-12T04:16:23.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17272024-12-12T04:16:23.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17282024-12-12T04:16:23.683ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
17292024-12-12T04:16:23.683ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.50444ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
17302024-12-12T04:16:23.689ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17312024-12-12T04:16:23.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17322024-12-12T04:16:23.717ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.004534ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17332024-12-12T04:16:23.908ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 541 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = f9ec08e5-18b8-4069-8476-b334f5149f36 response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
17342024-12-12T04:16:24.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 576073bf-9df3-491d-b9fb-754eb7b80294 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17352024-12-12T04:16:24.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 576073bf-9df3-491d-b9fb-754eb7b80294 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17362024-12-12T04:16:24.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 576073bf-9df3-491d-b9fb-754eb7b80294 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17372024-12-12T04:16:25.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = fff325f0-8b01-4551-be7d-4167b9cfc2b1 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17382024-12-12T04:16:25.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = fff325f0-8b01-4551-be7d-4167b9cfc2b1 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17392024-12-12T04:16:25.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = fff325f0-8b01-4551-be7d-4167b9cfc2b1 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17402024-12-12T04:16:26.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2418e120-17e0-4c1a-a9b1-e482dcc07341 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17412024-12-12T04:16:26.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2418e120-17e0-4c1a-a9b1-e482dcc07341 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17422024-12-12T04:16:26.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2806 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2418e120-17e0-4c1a-a9b1-e482dcc07341 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17432024-12-12T04:16:27.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9d19b929-1dd9-48a2-9932-bedf824ab2a3 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17442024-12-12T04:16:27.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9d19b929-1dd9-48a2-9932-bedf824ab2a3 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17452024-12-12T04:16:27.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2793 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9d19b929-1dd9-48a2-9932-bedf824ab2a3 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17462024-12-12T04:16:28.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1d2faf28-dfac-4acb-9a75-62b524a08e7e roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17472024-12-12T04:16:28.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1d2faf28-dfac-4acb-9a75-62b524a08e7e resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17482024-12-12T04:16:28.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1d2faf28-dfac-4acb-9a75-62b524a08e7e response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17492024-12-12T04:16:29.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 757fa2e4-683e-42d7-8e98-c26adf7bda85 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17502024-12-12T04:16:29.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 757fa2e4-683e-42d7-8e98-c26adf7bda85 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17512024-12-12T04:16:29.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 757fa2e4-683e-42d7-8e98-c26adf7bda85 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17522024-12-12T04:16:30.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 08f977f1-6b42-4192-b114-791829185782 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17532024-12-12T04:16:30.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 08f977f1-6b42-4192-b114-791829185782 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17542024-12-12T04:16:30.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 08f977f1-6b42-4192-b114-791829185782 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17552024-12-12T04:16:31.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 209068ab-7768-4248-a5f4-633970f56b4f roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17562024-12-12T04:16:31.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 209068ab-7768-4248-a5f4-633970f56b4f resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17572024-12-12T04:16:31.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 209068ab-7768-4248-a5f4-633970f56b4f response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17582024-12-12T04:16:32.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 50605537-19ef-4ba5-8994-091010bde045 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17592024-12-12T04:16:32.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 50605537-19ef-4ba5-8994-091010bde045 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17602024-12-12T04:16:32.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2761 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 50605537-19ef-4ba5-8994-091010bde045 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17612024-12-12T04:16:33.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5aec1798-f092-470c-a45c-af03d3b662d0 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17622024-12-12T04:16:33.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5aec1798-f092-470c-a45c-af03d3b662d0 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17632024-12-12T04:16:33.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5aec1798-f092-470c-a45c-af03d3b662d0 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17642024-12-12T04:16:33.659ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
17652024-12-12T04:16:33.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17662024-12-12T04:16:33.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17672024-12-12T04:16:33.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
17682024-12-12T04:16:33.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17692024-12-12T04:16:33.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17702024-12-12T04:16:33.662ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17712024-12-12T04:16:33.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17722024-12-12T04:16:33.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17732024-12-12T04:16:33.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.69641ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17742024-12-12T04:16:33.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17752024-12-12T04:16:33.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17762024-12-12T04:16:33.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17772024-12-12T04:16:33.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17782024-12-12T04:16:33.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17792024-12-12T04:16:33.695ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17802024-12-12T04:16:33.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
17812024-12-12T04:16:33.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17822024-12-12T04:16:33.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17832024-12-12T04:16:33.708ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
17842024-12-12T04:16:33.708ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.517004ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
17852024-12-12T04:16:33.909ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 968 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = 6758418f-7bcf-4021-8697-9b4fad8caec3 response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
17862024-12-12T04:16:34.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5ecf07f6-b24a-4bc5-8eeb-41933c9291ab roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17872024-12-12T04:16:34.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5ecf07f6-b24a-4bc5-8eeb-41933c9291ab resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17882024-12-12T04:16:34.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5ecf07f6-b24a-4bc5-8eeb-41933c9291ab response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17892024-12-12T04:16:35.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7af1184f-a73d-43cf-8626-b100d6ba38bd roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17902024-12-12T04:16:35.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7af1184f-a73d-43cf-8626-b100d6ba38bd resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17912024-12-12T04:16:35.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7af1184f-a73d-43cf-8626-b100d6ba38bd response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17922024-12-12T04:16:36.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 51375208-c93b-4100-9fdd-a9c96392bbf1 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17932024-12-12T04:16:36.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 51375208-c93b-4100-9fdd-a9c96392bbf1 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17942024-12-12T04:16:36.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 51375208-c93b-4100-9fdd-a9c96392bbf1 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17952024-12-12T04:16:37.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = d12e369b-e86e-4dbf-87d2-49bd58df3434 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17962024-12-12T04:16:37.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = d12e369b-e86e-4dbf-87d2-49bd58df3434 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17972024-12-12T04:16:37.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = d12e369b-e86e-4dbf-87d2-49bd58df3434 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17982024-12-12T04:16:38.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 14cc527b-d8dd-4e20-a3d9-5c7ad6be4ece roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
17992024-12-12T04:16:38.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 14cc527b-d8dd-4e20-a3d9-5c7ad6be4ece resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18002024-12-12T04:16:38.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 14cc527b-d8dd-4e20-a3d9-5c7ad6be4ece response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18012024-12-12T04:16:39.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3e78b7b3-4a05-4924-b5fe-1bd1552d1973 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18022024-12-12T04:16:39.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3e78b7b3-4a05-4924-b5fe-1bd1552d1973 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18032024-12-12T04:16:39.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3e78b7b3-4a05-4924-b5fe-1bd1552d1973 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18042024-12-12T04:16:40.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3bad761c-f7c2-497b-9f95-1f339745619a roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18052024-12-12T04:16:40.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3bad761c-f7c2-497b-9f95-1f339745619a resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18062024-12-12T04:16:40.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3bad761c-f7c2-497b-9f95-1f339745619a response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18072024-12-12T04:16:41.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1c5bd927-8590-4c74-9717-c85b4105e1b6 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18082024-12-12T04:16:41.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1c5bd927-8590-4c74-9717-c85b4105e1b6 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18092024-12-12T04:16:41.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1c5bd927-8590-4c74-9717-c85b4105e1b6 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18102024-12-12T04:16:42.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b0974595-6887-4270-9154-3ff83f3baa99 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18112024-12-12T04:16:42.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b0974595-6887-4270-9154-3ff83f3baa99 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18122024-12-12T04:16:42.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b0974595-6887-4270-9154-3ff83f3baa99 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18132024-12-12T04:16:43.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 95ceeda0-848f-4af6-ab5a-b964c6ccbcec roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18142024-12-12T04:16:43.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 95ceeda0-848f-4af6-ab5a-b964c6ccbcec resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18152024-12-12T04:16:43.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 95ceeda0-848f-4af6-ab5a-b964c6ccbcec response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
18162024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
18172024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
18182024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18192024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18202024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
18212024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
18222024-12-12T04:16:43.659ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18232024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18242024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
18252024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
18262024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18272024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
18282024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18292024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18302024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
18312024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
18322024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18332024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18342024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
18352024-12-12T04:16:43.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18362024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18372024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18382024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18392024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18402024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18412024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18422024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18432024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18442024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18452024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
18462024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
18472024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18482024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18492024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18502024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
18512024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
18522024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18532024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18542024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
18552024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
18562024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18572024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18582024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
18592024-12-12T04:16:43.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18602024-12-12T04:16:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18612024-12-12T04:16:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18622024-12-12T04:16:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18632024-12-12T04:16:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18642024-12-12T04:16:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18652024-12-12T04:16:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18662024-12-12T04:16:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18672024-12-12T04:16:43.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18682024-12-12T04:16:43.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18692024-12-12T04:16:43.663ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18702024-12-12T04:16:43.663ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.985394ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18712024-12-12T04:16:43.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18722024-12-12T04:16:43.664ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4436, tv_nsec: 469037172 } })
18732024-12-12T04:16:43.664ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
18742024-12-12T04:16:43.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18752024-12-12T04:16:43.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18762024-12-12T04:16:43.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18772024-12-12T04:16:43.665ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18782024-12-12T04:16:43.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18792024-12-12T04:16:43.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18802024-12-12T04:16:43.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18812024-12-12T04:16:43.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18822024-12-12T04:16:43.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18832024-12-12T04:16:43.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18842024-12-12T04:16:43.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18852024-12-12T04:16:43.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18862024-12-12T04:16:43.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18872024-12-12T04:16:43.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18882024-12-12T04:16:43.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18892024-12-12T04:16:43.668ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18902024-12-12T04:16:43.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18912024-12-12T04:16:43.669ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4436, tv_nsec: 474559964 } })
18922024-12-12T04:16:43.670ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
18932024-12-12T04:16:43.670ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18942024-12-12T04:16:43.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18952024-12-12T04:16:43.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18962024-12-12T04:16:43.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18972024-12-12T04:16:43.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18982024-12-12T04:16:43.672ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18992024-12-12T04:16:43.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19002024-12-12T04:16:43.672ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19012024-12-12T04:16:43.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19022024-12-12T04:16:43.673ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19032024-12-12T04:16:43.673ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19042024-12-12T04:16:43.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19052024-12-12T04:16:43.674ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.931772ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19062024-12-12T04:16:43.674ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19072024-12-12T04:16:43.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19082024-12-12T04:16:43.675ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4436, tv_nsec: 479722821 } })
19092024-12-12T04:16:43.675ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19102024-12-12T04:16:43.675ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19112024-12-12T04:16:43.675ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
19122024-12-12T04:16:43.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19132024-12-12T04:16:43.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19142024-12-12T04:16:43.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19152024-12-12T04:16:43.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19162024-12-12T04:16:43.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19172024-12-12T04:16:43.678ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19182024-12-12T04:16:43.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19192024-12-12T04:16:43.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19202024-12-12T04:16:43.680ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19212024-12-12T04:16:43.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19222024-12-12T04:16:43.681ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19232024-12-12T04:16:43.681ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.856725ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19242024-12-12T04:16:43.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
19252024-12-12T04:16:43.681ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19262024-12-12T04:16:43.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19272024-12-12T04:16:43.691ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
19282024-12-12T04:16:43.691ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.297236ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
19292024-12-12T04:16:43.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 37.0663ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
19302024-12-12T04:16:43.700ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.080612ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
19312024-12-12T04:16:43.701ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19322024-12-12T04:16:43.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19332024-12-12T04:16:43.703ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19342024-12-12T04:16:43.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19352024-12-12T04:16:43.704ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19362024-12-12T04:16:43.704ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19372024-12-12T04:16:43.704ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19382024-12-12T04:16:43.704ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19392024-12-12T04:16:43.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19402024-12-12T04:16:43.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19412024-12-12T04:16:43.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 44.762421ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
19422024-12-12T04:16:43.706ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19432024-12-12T04:16:43.707ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19442024-12-12T04:16:43.707ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19452024-12-12T04:16:43.707ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19462024-12-12T04:16:43.707ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19472024-12-12T04:16:43.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19482024-12-12T04:16:43.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19492024-12-12T04:16:43.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80af691a-30bb-4399-8524-a68071b516df, lookup_type: ById(80af691a-30bb-4399-8524-a68071b516df) } result = Ok(())
19502024-12-12T04:16:43.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19512024-12-12T04:16:43.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19522024-12-12T04:16:43.710ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 51.217307ms iteration = 26 status = 0
19532024-12-12T04:16:43.715ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 54.897255ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19542024-12-12T04:16:43.722ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 62.734857ms iteration = 29 status = {"physical_disks_added":0}
19552024-12-12T04:16:43.738ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 77.725486ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
19562024-12-12T04:16:43.741ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19572024-12-12T04:16:43.741ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19582024-12-12T04:16:43.741ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 80.902494ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19592024-12-12T04:16:43.759ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19602024-12-12T04:16:43.759ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19612024-12-12T04:16:43.759ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e645b9e-e040-4dac-b043-120d0e9ae95a", "content-length": "26", "date": "Thu, 12 Dec 2024 04:16:42 GMT"} })
19622024-12-12T04:16:43.759ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19632024-12-12T04:16:43.761ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19642024-12-12T04:16:43.775ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19652024-12-12T04:16:43.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19662024-12-12T04:16:43.777ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19672024-12-12T04:16:43.778ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19682024-12-12T04:16:43.778ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19692024-12-12T04:16:43.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19702024-12-12T04:16:43.780ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e zone_address = fd00:1122:3344:101::2
19712024-12-12T04:16:43.780ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19722024-12-12T04:16:43.780ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19732024-12-12T04:16:43.780ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc454834-65a3-4d2d-ba1b-ca9b69fe3eb8", "content-length": "26", "date": "Thu, 12 Dec 2024 04:16:43 GMT"} })
19742024-12-12T04:16:43.780ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19752024-12-12T04:16:43.780ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19762024-12-12T04:16:43.780ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19772024-12-12T04:16:43.780ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cb2fd83-3f99-4f9e-a497-492a3de4e243", "content-length": "26", "date": "Thu, 12 Dec 2024 04:16:43 GMT"} })
19782024-12-12T04:16:43.780ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19792024-12-12T04:16:43.781ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
19802024-12-12T04:16:43.781ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19812024-12-12T04:16:43.781ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19822024-12-12T04:16:43.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19832024-12-12T04:16:43.782ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19842024-12-12T04:16:43.793ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19852024-12-12T04:16:43.793ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19862024-12-12T04:16:43.793ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9290df57-f7d9-48fa-8e37-86726a24c6c9", "content-length": "372", "date": "Thu, 12 Dec 2024 04:16:43 GMT"} })
19872024-12-12T04:16:43.793ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19882024-12-12T04:16:43.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19892024-12-12T04:16:43.837ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
19902024-12-12T04:16:43.837ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
19912024-12-12T04:16:43.837ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "300f9a84-0679-4408-8191-4962270a90df", "date": "Thu, 12 Dec 2024 04:16:43 GMT"} })
19922024-12-12T04:16:43.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19932024-12-12T04:16:43.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19942024-12-12T04:16:43.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19952024-12-12T04:16:43.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19962024-12-12T04:16:43.863ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19972024-12-12T04:16:43.863ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c48ada4-82dc-429a-8059-54c6e0404b32", "content-length": "2", "date": "Thu, 12 Dec 2024 04:16:43 GMT"} })
19982024-12-12T04:16:43.865ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19992024-12-12T04:16:43.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20002024-12-12T04:16:43.887ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 226.46569ms iteration = 26 status = {}
20012024-12-12T04:16:43.909ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 511 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = f66559cf-1f23-4fc5-8612-db2396356758 response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
20022024-12-12T04:16:43.963ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20032024-12-12T04:16:43.963ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb11daa3-e067-49e2-8685-779b992769de", "content-length": "691", "date": "Thu, 12 Dec 2024 04:16:43 GMT"} })
20042024-12-12T04:16:43.963ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
20052024-12-12T04:16:43.963ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
20062024-12-12T04:16:43.963ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
20072024-12-12T04:16:43.964ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 304.82584ms iteration = 27 status = {}
20082024-12-12T04:16:43.965ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 305.68432ms iteration = 26 status = null
20092024-12-12T04:16:43.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20102024-12-12T04:16:43.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20112024-12-12T04:16:43.969ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20122024-12-12T04:16:43.969ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20132024-12-12T04:16:43.970ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b6632402-aa85-414c-b802-27cc6aa21495", "date": "Thu, 12 Dec 2024 04:16:43 GMT"} })
20142024-12-12T04:16:43.972ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 312.553226ms iteration = 27 status = {}
20152024-12-12T04:16:44.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20162024-12-12T04:16:44.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20172024-12-12T04:16:44.020ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c4635247-5d4b-4f7c-ae5e-b1d4df6bd7b3, rack_id: 1612ec8d-a72c-445a-999f-274daa8c155e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(16ab99da-4da3-4a67-a57e-4d569b0ca16d) } rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0
20182024-12-12T04:16:44.020ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20192024-12-12T04:16:44.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20202024-12-12T04:16:44.029ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20212024-12-12T04:16:44.029ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b4fa353-d9b0-4698-a7ad-95e1d3fb352c", "content-length": "134", "date": "Thu, 12 Dec 2024 04:16:44 GMT"} })
20222024-12-12T04:16:44.029ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
20232024-12-12T04:16:44.029ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 16ab99da-4da3-4a67-a57e-4d569b0ca16d
20242024-12-12T04:16:44.029ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20252024-12-12T04:16:44.029ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20262024-12-12T04:16:44.029ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20272024-12-12T04:16:44.029ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20282024-12-12T04:16:44.029ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20292024-12-12T04:16:44.029ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20302024-12-12T04:16:44.029ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20312024-12-12T04:16:44.029ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20322024-12-12T04:16:44.030ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
20332024-12-12T04:16:44.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20342024-12-12T04:16:44.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20352024-12-12T04:16:44.032ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20362024-12-12T04:16:44.032ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dac9af1f-869f-4330-a136-fca81cd10e7d", "content-length": "2", "date": "Thu, 12 Dec 2024 04:16:44 GMT"} })
20372024-12-12T04:16:44.032ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20382024-12-12T04:16:44.032ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b4c1e04-3136-4abd-adb4-513328524951", "content-length": "52", "date": "Thu, 12 Dec 2024 04:16:44 GMT"} })
20392024-12-12T04:16:44.032ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0
20402024-12-12T04:16:44.032ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20412024-12-12T04:16:44.125ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "72bb758c-0202-426f-a965-fed192d7d692", "date": "Thu, 12 Dec 2024 04:16:44 GMT"} })
20422024-12-12T04:16:44.125ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch = Switch0
20432024-12-12T04:16:44.125ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20442024-12-12T04:16:44.126ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ebf57b2-0f11-46ec-be7e-62297e1c6b29", "content-length": "682", "date": "Thu, 12 Dec 2024 04:16:44 GMT"} })
20452024-12-12T04:16:44.126ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20462024-12-12T04:16:44.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20472024-12-12T04:16:44.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20482024-12-12T04:16:44.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20492024-12-12T04:16:44.133ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20502024-12-12T04:16:44.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20512024-12-12T04:16:44.135ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20522024-12-12T04:16:44.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20532024-12-12T04:16:44.143ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 483.560511ms iteration = 26 status = {}
20542024-12-12T04:16:44.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b8daa0cb-803c-471e-b564-c932a6ca92e9 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20552024-12-12T04:16:44.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b8daa0cb-803c-471e-b564-c932a6ca92e9 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20562024-12-12T04:16:44.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b8daa0cb-803c-471e-b564-c932a6ca92e9 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20572024-12-12T04:16:45.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2cfc35a6-5934-43e6-9557-15c1113e080c roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20582024-12-12T04:16:45.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2cfc35a6-5934-43e6-9557-15c1113e080c resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20592024-12-12T04:16:45.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2cfc35a6-5934-43e6-9557-15c1113e080c response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20602024-12-12T04:16:46.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 0bd2f73a-ef6f-4328-9225-2b6f570094f1 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20612024-12-12T04:16:46.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 0bd2f73a-ef6f-4328-9225-2b6f570094f1 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20622024-12-12T04:16:46.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 0bd2f73a-ef6f-4328-9225-2b6f570094f1 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20632024-12-12T04:16:47.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b4446ee0-d431-440b-9b0a-8d725755071b roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20642024-12-12T04:16:47.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b4446ee0-d431-440b-9b0a-8d725755071b resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20652024-12-12T04:16:47.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b4446ee0-d431-440b-9b0a-8d725755071b response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20662024-12-12T04:16:48.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9f9034e9-cf10-45ac-a6a1-d7135b376f45 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20672024-12-12T04:16:48.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9f9034e9-cf10-45ac-a6a1-d7135b376f45 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20682024-12-12T04:16:48.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9f9034e9-cf10-45ac-a6a1-d7135b376f45 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20692024-12-12T04:16:49.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9feefdab-ef3f-4e40-afab-45dbfe4fa727 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20702024-12-12T04:16:49.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9feefdab-ef3f-4e40-afab-45dbfe4fa727 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20712024-12-12T04:16:49.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9feefdab-ef3f-4e40-afab-45dbfe4fa727 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20722024-12-12T04:16:50.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 520aa71e-cc0a-40fb-9c13-b1f8f1bf3c1e roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20732024-12-12T04:16:50.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 520aa71e-cc0a-40fb-9c13-b1f8f1bf3c1e resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20742024-12-12T04:16:50.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 520aa71e-cc0a-40fb-9c13-b1f8f1bf3c1e response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20752024-12-12T04:16:51.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2f601053-b6b4-48db-be37-4fcb61d0f850 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20762024-12-12T04:16:51.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2f601053-b6b4-48db-be37-4fcb61d0f850 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20772024-12-12T04:16:51.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2f601053-b6b4-48db-be37-4fcb61d0f850 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20782024-12-12T04:16:52.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5456c626-4644-4b7e-ad6e-dc667fc6965b roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20792024-12-12T04:16:52.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5456c626-4644-4b7e-ad6e-dc667fc6965b resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20802024-12-12T04:16:52.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5456c626-4644-4b7e-ad6e-dc667fc6965b response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20812024-12-12T04:16:53.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9c5afbcb-94ef-4b55-b33c-bbf762389d1a roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20822024-12-12T04:16:53.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9c5afbcb-94ef-4b55-b33c-bbf762389d1a resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20832024-12-12T04:16:53.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9c5afbcb-94ef-4b55-b33c-bbf762389d1a response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
20842024-12-12T04:16:53.659ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
20852024-12-12T04:16:53.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20862024-12-12T04:16:53.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20872024-12-12T04:16:53.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
20882024-12-12T04:16:53.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20892024-12-12T04:16:53.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20902024-12-12T04:16:53.662ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20912024-12-12T04:16:53.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20922024-12-12T04:16:53.689ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20932024-12-12T04:16:53.689ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.646459ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20942024-12-12T04:16:53.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20952024-12-12T04:16:53.691ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20962024-12-12T04:16:53.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20972024-12-12T04:16:53.694ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20982024-12-12T04:16:53.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20992024-12-12T04:16:53.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21002024-12-12T04:16:53.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
21012024-12-12T04:16:53.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21022024-12-12T04:16:53.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21032024-12-12T04:16:53.709ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
21042024-12-12T04:16:53.709ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.690257ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
21052024-12-12T04:16:53.909ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 567 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = 39a56195-fc24-4e0d-826a-d7630d57da27 response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
21062024-12-12T04:16:54.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9e0f8c84-7c32-4538-a732-c4997dc1b836 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21072024-12-12T04:16:54.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9e0f8c84-7c32-4538-a732-c4997dc1b836 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21082024-12-12T04:16:54.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9e0f8c84-7c32-4538-a732-c4997dc1b836 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21092024-12-12T04:16:55.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4876f928-b218-4faf-8d41-f89e51d18a6e roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21102024-12-12T04:16:55.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4876f928-b218-4faf-8d41-f89e51d18a6e resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21112024-12-12T04:16:55.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4876f928-b218-4faf-8d41-f89e51d18a6e response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21122024-12-12T04:16:56.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1da6de10-aa91-45ef-857a-dcc6d57c2aef roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21132024-12-12T04:16:56.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1da6de10-aa91-45ef-857a-dcc6d57c2aef resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21142024-12-12T04:16:56.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 1da6de10-aa91-45ef-857a-dcc6d57c2aef response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21152024-12-12T04:16:57.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 224ac502-e78c-4185-bdfc-bcf0e90ebd8d roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21162024-12-12T04:16:57.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 224ac502-e78c-4185-bdfc-bcf0e90ebd8d resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21172024-12-12T04:16:57.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 224ac502-e78c-4185-bdfc-bcf0e90ebd8d response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21182024-12-12T04:16:58.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9013bfbf-42a0-41f1-b577-3f30b2aaa68a roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21192024-12-12T04:16:58.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9013bfbf-42a0-41f1-b577-3f30b2aaa68a resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21202024-12-12T04:16:58.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9013bfbf-42a0-41f1-b577-3f30b2aaa68a response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21212024-12-12T04:16:59.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 544af84a-8940-4c07-9b47-18a458d5f6a5 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21222024-12-12T04:16:59.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 544af84a-8940-4c07-9b47-18a458d5f6a5 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21232024-12-12T04:16:59.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 544af84a-8940-4c07-9b47-18a458d5f6a5 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21242024-12-12T04:17:00.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 0bea902c-ccdf-4239-8950-38a01f9f2c7b roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21252024-12-12T04:17:00.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 0bea902c-ccdf-4239-8950-38a01f9f2c7b resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21262024-12-12T04:17:00.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 0bea902c-ccdf-4239-8950-38a01f9f2c7b response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21272024-12-12T04:17:01.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8a538b25-610a-49fa-a88b-b078e1991716 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21282024-12-12T04:17:01.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8a538b25-610a-49fa-a88b-b078e1991716 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21292024-12-12T04:17:01.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8a538b25-610a-49fa-a88b-b078e1991716 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21302024-12-12T04:17:02.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 30f0139b-b44d-458f-96ef-aedf7aa09e7c roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21312024-12-12T04:17:02.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 30f0139b-b44d-458f-96ef-aedf7aa09e7c resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21322024-12-12T04:17:02.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1762 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 30f0139b-b44d-458f-96ef-aedf7aa09e7c response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21332024-12-12T04:17:03.659ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
21342024-12-12T04:17:03.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21352024-12-12T04:17:03.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21362024-12-12T04:17:03.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
21372024-12-12T04:17:03.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21382024-12-12T04:17:03.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21392024-12-12T04:17:03.662ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21402024-12-12T04:17:03.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21412024-12-12T04:17:03.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21422024-12-12T04:17:03.663ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.299532ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21432024-12-12T04:17:03.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21442024-12-12T04:17:03.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21452024-12-12T04:17:03.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21462024-12-12T04:17:03.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21472024-12-12T04:17:03.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21482024-12-12T04:17:03.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21492024-12-12T04:17:03.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
21502024-12-12T04:17:03.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21512024-12-12T04:17:03.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21522024-12-12T04:17:03.680ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
21532024-12-12T04:17:03.680ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.320432ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
21542024-12-12T04:17:03.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b5a06cfb-7b1f-4c09-8b90-d224780c9b6c roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21552024-12-12T04:17:03.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b5a06cfb-7b1f-4c09-8b90-d224780c9b6c resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21562024-12-12T04:17:03.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b5a06cfb-7b1f-4c09-8b90-d224780c9b6c response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21572024-12-12T04:17:03.909ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 846 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = 17fd48f2-d096-4685-b41b-68baf2935950 response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
21582024-12-12T04:17:04.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = de8d29b5-ddaa-45c0-8cd2-2912868153cf roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21592024-12-12T04:17:04.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = de8d29b5-ddaa-45c0-8cd2-2912868153cf resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21602024-12-12T04:17:04.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = de8d29b5-ddaa-45c0-8cd2-2912868153cf response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21612024-12-12T04:17:05.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8bddd2dd-1563-4435-8702-19c8295a479c roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21622024-12-12T04:17:05.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8bddd2dd-1563-4435-8702-19c8295a479c resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21632024-12-12T04:17:05.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8bddd2dd-1563-4435-8702-19c8295a479c response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21642024-12-12T04:17:06.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 43769d21-899d-46e1-bae4-c52b904fb9df roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21652024-12-12T04:17:06.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 43769d21-899d-46e1-bae4-c52b904fb9df resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21662024-12-12T04:17:06.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 43769d21-899d-46e1-bae4-c52b904fb9df response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21672024-12-12T04:17:07.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 10722287-2c39-4130-b3ec-eafdbd4d7c22 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21682024-12-12T04:17:07.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 10722287-2c39-4130-b3ec-eafdbd4d7c22 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21692024-12-12T04:17:07.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 10722287-2c39-4130-b3ec-eafdbd4d7c22 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21702024-12-12T04:17:08.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = f0b3ff75-abdc-4b74-921e-b14a519a8379 roles = RoleSet { roles: {} } uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?sort_by=id_ascending
21712024-12-12T04:17:08.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = f0b3ff75-abdc-4b74-921e-b14a519a8379 resource = Database result = Ok(()) uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?sort_by=id_ascending
21722024-12-12T04:17:08.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2753 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = f0b3ff75-abdc-4b74-921e-b14a519a8379 response_code = 200 uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?sort_by=id_ascending
21732024-12-12T04:17:08.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 834094d2-4139-43ea-a283-32c06548700d roles = RoleSet { roles: {} } uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYWFmOWFmNi0xYTg2LTQ5MGUtYjI1Zi02YWUwZWQ0MTkxMjEifX0%3D
21742024-12-12T04:17:08.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 834094d2-4139-43ea-a283-32c06548700d resource = Database result = Ok(()) uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYWFmOWFmNi0xYTg2LTQ5MGUtYjI1Zi02YWUwZWQ0MTkxMjEifX0%3D
21752024-12-12T04:17:08.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 834094d2-4139-43ea-a283-32c06548700d response_code = 200 uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYWFmOWFmNi0xYTg2LTQ5MGUtYjI1Zi02YWUwZWQ0MTkxMjEifX0%3D
21762024-12-12T04:17:08.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b95038f7-37bb-4978-8b18-3af74700a7d3 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21772024-12-12T04:17:08.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b95038f7-37bb-4978-8b18-3af74700a7d3 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21782024-12-12T04:17:08.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b95038f7-37bb-4978-8b18-3af74700a7d3 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21792024-12-12T04:17:09.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 429be912-21bf-4c81-a5fc-96f5ba4841a2 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21802024-12-12T04:17:09.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 429be912-21bf-4c81-a5fc-96f5ba4841a2 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21812024-12-12T04:17:09.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 429be912-21bf-4c81-a5fc-96f5ba4841a2 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21822024-12-12T04:17:11.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 74920558-dbfd-4de3-bc59-a33d69c3114e roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21832024-12-12T04:17:11.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 74920558-dbfd-4de3-bc59-a33d69c3114e resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21842024-12-12T04:17:11.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 74920558-dbfd-4de3-bc59-a33d69c3114e response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21852024-12-12T04:17:12.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b3ee8dd4-59ca-48d1-b44d-b3e98c3be2fc roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21862024-12-12T04:17:12.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b3ee8dd4-59ca-48d1-b44d-b3e98c3be2fc resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21872024-12-12T04:17:12.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2574 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b3ee8dd4-59ca-48d1-b44d-b3e98c3be2fc response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21882024-12-12T04:17:13.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 38ca60b5-7ba4-4128-898e-293df047dd55 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21892024-12-12T04:17:13.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 38ca60b5-7ba4-4128-898e-293df047dd55 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21902024-12-12T04:17:13.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 38ca60b5-7ba4-4128-898e-293df047dd55 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
21912024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
21922024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
21932024-12-12T04:17:13.660ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
21942024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
21952024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21962024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
21972024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
21982024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
21992024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22002024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
22012024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22022024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
22032024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
22042024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
22052024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22062024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
22072024-12-12T04:17:13.660ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22082024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
22092024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22102024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
22112024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22122024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
22132024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
22142024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22152024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
22162024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22172024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
22182024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22192024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
22202024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
22212024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22222024-12-12T04:17:13.660ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1fe61f23-9928-4fa9-a236-a7026965e207
22232024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
22242024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.371\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"1fe61f23-9928-4fa9-a236-a7026965e207"}
22252024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22262024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
22272024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22282024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
22292024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22302024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
22312024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
22322024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22332024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
22342024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22352024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22362024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
22372024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22382024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
22392024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22402024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
22412024-12-12T04:17:13.660ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
22422024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22432024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22442024-12-12T04:17:13.661ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-12 04:07:13.660520759 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
22452024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
22462024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
22472024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
22482024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22492024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
22502024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
22512024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22522024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
22532024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
22542024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
22552024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22562024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22572024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
22582024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22592024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
22602024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22612024-12-12T04:17:13.661ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bb732d7-5c6c-418e-9bb4-2b78363c496b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a6e7ea12-5d7a-4497-b4c7-99b34dca3373.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a6e7ea12-5d7a-4497-b4c7-99b34dca3373.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 4466, tv_nsec: 465606596 } })
22622024-12-12T04:17:13.661ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("68b92f4b-c208-4567-8395-96046a9b6c9a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c9c9afd6-aa03-4a96-8241-6ae7ccfbce28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d24a9d9f-7884-44e6-bf52-febe49c3b719.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d24a9d9f-7884-44e6-bf52-febe49c3b719.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 4466, tv_nsec: 465623306 } })
22632024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22642024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22652024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22662024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22672024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
22682024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
22692024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22702024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
22712024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22722024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22732024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22742024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
22752024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22762024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22772024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22782024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22792024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
22802024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.13782ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
22812024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
22822024-12-12T04:17:13.661ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.420588ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
22832024-12-12T04:17:13.663ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22842024-12-12T04:17:13.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22852024-12-12T04:17:13.663ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22862024-12-12T04:17:13.664ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.456787ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22872024-12-12T04:17:13.664ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.620929ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
22882024-12-12T04:17:13.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
22892024-12-12T04:17:13.665ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22902024-12-12T04:17:13.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22912024-12-12T04:17:13.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22922024-12-12T04:17:13.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22932024-12-12T04:17:13.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22942024-12-12T04:17:13.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22952024-12-12T04:17:13.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22962024-12-12T04:17:13.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22972024-12-12T04:17:13.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22982024-12-12T04:17:13.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22992024-12-12T04:17:13.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23002024-12-12T04:17:13.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23012024-12-12T04:17:13.668ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23022024-12-12T04:17:13.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23032024-12-12T04:17:13.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23042024-12-12T04:17:13.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23052024-12-12T04:17:13.671ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4466, tv_nsec: 475665998 } })
23062024-12-12T04:17:13.672ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
23072024-12-12T04:17:13.673ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23082024-12-12T04:17:13.674ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-12 04:07:13.660520759 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
23092024-12-12T04:17:13.674ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.548531ms iteration = 14 status = {"expiration":"2024-12-12T04:07:13.660520759Z","pruned":[]}
23102024-12-12T04:17:13.675ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23112024-12-12T04:17:13.675ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23122024-12-12T04:17:13.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23132024-12-12T04:17:13.675ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4466, tv_nsec: 480482286 } })
23142024-12-12T04:17:13.676ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
23152024-12-12T04:17:13.676ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
23162024-12-12T04:17:13.676ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 15.44456ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
23172024-12-12T04:17:13.676ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
23182024-12-12T04:17:13.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23192024-12-12T04:17:13.680ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23202024-12-12T04:17:13.681ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23212024-12-12T04:17:13.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23222024-12-12T04:17:13.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23232024-12-12T04:17:13.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23242024-12-12T04:17:13.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23252024-12-12T04:17:13.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23262024-12-12T04:17:13.684ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4466, tv_nsec: 488983546 } })
23272024-12-12T04:17:13.684ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
23282024-12-12T04:17:13.685ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23292024-12-12T04:17:13.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23302024-12-12T04:17:13.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23312024-12-12T04:17:13.689ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23322024-12-12T04:17:13.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23332024-12-12T04:17:13.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23342024-12-12T04:17:13.690ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23352024-12-12T04:17:13.690ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23362024-12-12T04:17:13.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23372024-12-12T04:17:13.692ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23382024-12-12T04:17:13.692ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23392024-12-12T04:17:13.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23402024-12-12T04:17:13.692ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23412024-12-12T04:17:13.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23422024-12-12T04:17:13.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23432024-12-12T04:17:13.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23442024-12-12T04:17:13.694ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23452024-12-12T04:17:13.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23462024-12-12T04:17:13.699ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23472024-12-12T04:17:13.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23482024-12-12T04:17:13.701ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23492024-12-12T04:17:13.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23502024-12-12T04:17:13.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23512024-12-12T04:17:13.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23522024-12-12T04:17:13.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.383928ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
23532024-12-12T04:17:13.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23542024-12-12T04:17:13.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23552024-12-12T04:17:13.716ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23562024-12-12T04:17:13.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23572024-12-12T04:17:13.719ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23582024-12-12T04:17:13.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23592024-12-12T04:17:13.721ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 60.826058ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
23602024-12-12T04:17:13.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23612024-12-12T04:17:13.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23622024-12-12T04:17:13.729ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.38012ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23632024-12-12T04:17:13.731ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23642024-12-12T04:17:13.731ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23652024-12-12T04:17:13.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23662024-12-12T04:17:13.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23672024-12-12T04:17:13.732ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23682024-12-12T04:17:13.732ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23692024-12-12T04:17:13.732ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.240575ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23702024-12-12T04:17:13.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23712024-12-12T04:17:13.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23722024-12-12T04:17:13.733ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.572842ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
23732024-12-12T04:17:13.734ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 73.709476ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
23742024-12-12T04:17:13.735ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
23752024-12-12T04:17:13.735ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
23762024-12-12T04:17:13.735ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 75.078863ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
23772024-12-12T04:17:13.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23782024-12-12T04:17:13.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23792024-12-12T04:17:13.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23802024-12-12T04:17:13.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23812024-12-12T04:17:13.739ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23822024-12-12T04:17:13.739ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
23832024-12-12T04:17:13.739ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
23842024-12-12T04:17:13.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23852024-12-12T04:17:13.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23862024-12-12T04:17:13.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
23872024-12-12T04:17:13.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23882024-12-12T04:17:13.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23892024-12-12T04:17:13.741ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
23902024-12-12T04:17:13.741ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
23912024-12-12T04:17:13.741ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
23922024-12-12T04:17:13.741ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23932024-12-12T04:17:13.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23942024-12-12T04:17:13.742ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.669913ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23952024-12-12T04:17:13.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23962024-12-12T04:17:13.742ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23972024-12-12T04:17:13.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23982024-12-12T04:17:13.744ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23992024-12-12T04:17:13.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24002024-12-12T04:17:13.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24012024-12-12T04:17:13.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24022024-12-12T04:17:13.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24032024-12-12T04:17:13.747ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24042024-12-12T04:17:13.747ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24052024-12-12T04:17:13.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24062024-12-12T04:17:13.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24072024-12-12T04:17:13.749ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24082024-12-12T04:17:13.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24092024-12-12T04:17:13.749ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24102024-12-12T04:17:13.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80af691a-30bb-4399-8524-a68071b516df, lookup_type: ById(80af691a-30bb-4399-8524-a68071b516df) } result = Ok(())
24112024-12-12T04:17:13.752ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24122024-12-12T04:17:13.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24132024-12-12T04:17:13.760ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 99.922566ms iteration = 27 status = 0
24142024-12-12T04:17:13.761ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
24152024-12-12T04:17:13.761ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 101.403686ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
24162024-12-12T04:17:13.769ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24172024-12-12T04:17:13.769ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24182024-12-12T04:17:13.769ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24192024-12-12T04:17:13.769ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24202024-12-12T04:17:13.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24212024-12-12T04:17:13.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24222024-12-12T04:17:13.772ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
24232024-12-12T04:17:13.772ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 112.113837ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
24242024-12-12T04:17:13.787ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24252024-12-12T04:17:13.788ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24262024-12-12T04:17:13.788ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3bc9d287-62fd-4054-a086-452fd6ea3148 dns_zone_name = oxide.test found_so_far = 0 version = 2
24272024-12-12T04:17:13.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24282024-12-12T04:17:13.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24292024-12-12T04:17:13.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24302024-12-12T04:17:13.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24312024-12-12T04:17:13.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24322024-12-12T04:17:13.796ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
24332024-12-12T04:17:13.798ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-12T04:04:09.118019Z, time_modified: 2024-12-12T04:04:09.118019Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, db_silo: Silo { identity: SiloIdentity { id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T04:04:19.153943Z, time_modified: 2024-12-12T04:04:19.153943Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "f0b8912fb2d95a3478b343431ad55a1239b7666e3e9123bdabc1900b27a1339c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, db_silo: Silo { identity: SiloIdentity { id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T04:04:19.153943Z, time_modified: 2024-12-12T04:04:19.153943Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "f0b8912fb2d95a3478b343431ad55a1239b7666e3e9123bdabc1900b27a1339c" }] }) }
24342024-12-12T04:17:13.798ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 137.6986ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"46bdf509-11b9-47c6-9aa0-67e689dc84db","tls_certs":["f0b8912fb2d95a3478b343431ad55a1239b7666e3e9123bdabc1900b27a1339c"]}},"default_endpoint":{"silo_id":"46bdf509-11b9-47c6-9aa0-67e689dc84db","tls_certs":["f0b8912fb2d95a3478b343431ad55a1239b7666e3e9123bdabc1900b27a1339c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
24352024-12-12T04:17:13.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24362024-12-12T04:17:13.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24372024-12-12T04:17:13.809ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24382024-12-12T04:17:13.809ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24392024-12-12T04:17:13.809ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 149.07521ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24402024-12-12T04:17:13.813ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 153.801423ms iteration = 30 status = {"physical_disks_added":0}
24412024-12-12T04:17:13.846ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e zone_address = fd00:1122:3344:101::2
24422024-12-12T04:17:13.846ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24432024-12-12T04:17:13.846ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "99ddd03a-9807-4934-aa73-cf41d8058e0a", "content-length": "26", "date": "Thu, 12 Dec 2024 04:17:13 GMT"} })
24442024-12-12T04:17:13.846ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24452024-12-12T04:17:13.848ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
24462024-12-12T04:17:13.909ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 542 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = 2500faf2-aca1-4244-9a0d-97ac89ec2ed1 response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
24472024-12-12T04:17:13.909ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
24482024-12-12T04:17:13.909ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24492024-12-12T04:17:13.910ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0f9783f-b7d5-433f-999e-3ea0e4a1c5e7", "content-length": "26", "date": "Thu, 12 Dec 2024 04:17:13 GMT"} })
24502024-12-12T04:17:13.910ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24512024-12-12T04:17:13.911ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24522024-12-12T04:17:13.920ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24532024-12-12T04:17:13.974ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
24542024-12-12T04:17:13.974ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24552024-12-12T04:17:13.974ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eba2caaf-aff9-41a5-9db1-12c682780fa6", "content-length": "26", "date": "Thu, 12 Dec 2024 04:17:13 GMT"} })
24562024-12-12T04:17:13.974ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24572024-12-12T04:17:13.976ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24582024-12-12T04:17:13.977ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
24592024-12-12T04:17:13.977ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24602024-12-12T04:17:13.977ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3833142d-1a8b-449a-aa60-243d4adc2eb1", "content-length": "372", "date": "Thu, 12 Dec 2024 04:17:13 GMT"} })
24612024-12-12T04:17:13.977ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24622024-12-12T04:17:13.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24632024-12-12T04:17:13.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24642024-12-12T04:17:13.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24652024-12-12T04:17:13.981ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24662024-12-12T04:17:13.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24672024-12-12T04:17:13.987ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3bc9d287-62fd-4054-a086-452fd6ea3148 dns_zone_name = oxide.test found_so_far = 1 version = 2
24682024-12-12T04:17:13.987ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
24692024-12-12T04:17:13.987ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-12 04:04:19.219093 UTC dns_group = external generation = 2
24702024-12-12T04:17:13.987ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 327.21579ms iteration = 14 status = {"generation":2}
24712024-12-12T04:17:13.998ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24722024-12-12T04:17:13.998ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "15c25c3e-6798-4fc9-9665-11ed711a8840", "date": "Thu, 12 Dec 2024 04:17:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24732024-12-12T04:17:13.998ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24742024-12-12T04:17:14.001ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4d99a41f-8d64-4d67-ace7-9d82233995b9", "date": "Thu, 12 Dec 2024 04:17:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24752024-12-12T04:17:14.001ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24762024-12-12T04:17:14.002ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24772024-12-12T04:17:14.002ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 342.603611ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
24782024-12-12T04:17:14.014ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
24792024-12-12T04:17:14.015ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 663b0867-5967-4e70-9e4c-e46bea4389d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
24802024-12-12T04:17:14.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24812024-12-12T04:17:14.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24822024-12-12T04:17:14.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24832024-12-12T04:17:14.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24842024-12-12T04:17:14.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24852024-12-12T04:17:14.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24862024-12-12T04:17:14.021ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 663b0867-5967-4e70-9e4c-e46bea4389d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
24872024-12-12T04:17:14.021ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
24882024-12-12T04:17:14.021ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-12 04:04:17.984914 UTC dns_group = internal generation = 1
24892024-12-12T04:17:14.021ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 361.458203ms iteration = 14 status = {"generation":1}
24902024-12-12T04:17:14.031ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
24912024-12-12T04:17:14.031ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
24922024-12-12T04:17:14.031ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "56b332c4-755a-41a1-8a52-8d307098d0ff", "date": "Thu, 12 Dec 2024 04:17:13 GMT"} })
24932024-12-12T04:17:14.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24942024-12-12T04:17:14.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24952024-12-12T04:17:14.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24962024-12-12T04:17:14.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24972024-12-12T04:17:14.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24982024-12-12T04:17:14.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24992024-12-12T04:17:14.041ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25002024-12-12T04:17:14.041ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25012024-12-12T04:17:14.041ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "292b4c78-478b-476b-b313-d8f950579777", "date": "Thu, 12 Dec 2024 04:17:13 GMT"} })
25022024-12-12T04:17:14.043ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 383.680383ms iteration = 28 status = {}
25032024-12-12T04:17:14.051ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 390.865845ms iteration = 27 status = {}
25042024-12-12T04:17:14.054ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
25052024-12-12T04:17:14.064ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25062024-12-12T04:17:14.065ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b630e486-7574-481b-bc4c-7019cd17e3ad", "content-length": "2", "date": "Thu, 12 Dec 2024 04:17:14 GMT"} })
25072024-12-12T04:17:14.067ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25082024-12-12T04:17:14.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25092024-12-12T04:17:14.068ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 408.546351ms iteration = 27 status = null
25102024-12-12T04:17:14.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 566161ef-e071-44e1-aa37-be93b001ba70 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25112024-12-12T04:17:14.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 566161ef-e071-44e1-aa37-be93b001ba70 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25122024-12-12T04:17:14.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 566161ef-e071-44e1-aa37-be93b001ba70 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25132024-12-12T04:17:14.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25142024-12-12T04:17:14.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25152024-12-12T04:17:14.095ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25162024-12-12T04:17:14.096ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a90348c1-0219-4c21-b288-d240d771669b", "date": "Thu, 12 Dec 2024 04:17:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25172024-12-12T04:17:14.096ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25182024-12-12T04:17:14.097ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f70c29b4-e39a-4b06-8816-36fc306e92a0", "date": "Thu, 12 Dec 2024 04:17:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25192024-12-12T04:17:14.097ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25202024-12-12T04:17:14.099ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "099992b3-8d3e-40a1-b655-e7584326289c", "date": "Thu, 12 Dec 2024 04:17:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25212024-12-12T04:17:14.099ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25222024-12-12T04:17:14.101ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25232024-12-12T04:17:14.101ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 441.016684ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25242024-12-12T04:17:14.113ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25252024-12-12T04:17:14.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25262024-12-12T04:17:14.115ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25272024-12-12T04:17:14.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25282024-12-12T04:17:14.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25292024-12-12T04:17:14.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25302024-12-12T04:17:14.116ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25312024-12-12T04:17:14.118ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25322024-12-12T04:17:14.118ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25332024-12-12T04:17:14.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25342024-12-12T04:17:14.118ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c4635247-5d4b-4f7c-ae5e-b1d4df6bd7b3, rack_id: 1612ec8d-a72c-445a-999f-274daa8c155e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(16ab99da-4da3-4a67-a57e-4d569b0ca16d) } rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0
25352024-12-12T04:17:14.118ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25362024-12-12T04:17:14.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25372024-12-12T04:17:14.129ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25382024-12-12T04:17:14.129ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf2c5400-f686-44f9-ac36-e7884e0d461c", "content-length": "134", "date": "Thu, 12 Dec 2024 04:17:14 GMT"} })
25392024-12-12T04:17:14.129ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
25402024-12-12T04:17:14.129ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 16ab99da-4da3-4a67-a57e-4d569b0ca16d
25412024-12-12T04:17:14.129ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
25422024-12-12T04:17:14.129ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25432024-12-12T04:17:14.129ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25442024-12-12T04:17:14.129ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25452024-12-12T04:17:14.129ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25462024-12-12T04:17:14.129ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25472024-12-12T04:17:14.129ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25482024-12-12T04:17:14.129ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25492024-12-12T04:17:14.130ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
25502024-12-12T04:17:14.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25512024-12-12T04:17:14.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25522024-12-12T04:17:14.132ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25532024-12-12T04:17:14.132ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd6f8966-b4aa-4af8-a9fe-7f112102db4b", "content-length": "2", "date": "Thu, 12 Dec 2024 04:17:14 GMT"} })
25542024-12-12T04:17:14.132ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25552024-12-12T04:17:14.132ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "76dcc572-e9d4-48f2-bb48-3d011504caa0", "content-length": "52", "date": "Thu, 12 Dec 2024 04:17:14 GMT"} })
25562024-12-12T04:17:14.132ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0
25572024-12-12T04:17:14.132ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25582024-12-12T04:17:14.151ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25592024-12-12T04:17:14.223ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "45ade2d9-0310-4b9a-b828-aadcc7ad411d", "date": "Thu, 12 Dec 2024 04:17:13 GMT"} })
25602024-12-12T04:17:14.223ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch = Switch0
25612024-12-12T04:17:14.223ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25622024-12-12T04:17:14.223ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4e7f292-620a-4df4-a411-d6f6ea77df56", "content-length": "691", "date": "Thu, 12 Dec 2024 04:17:13 GMT"} })
25632024-12-12T04:17:14.223ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
25642024-12-12T04:17:14.223ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
25652024-12-12T04:17:14.223ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
25662024-12-12T04:17:14.223ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "456eac26-9327-44ed-ac6c-b29fa4ef541e", "content-length": "682", "date": "Thu, 12 Dec 2024 04:17:14 GMT"} })
25672024-12-12T04:17:14.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25682024-12-12T04:17:14.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25692024-12-12T04:17:14.226ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 565.866169ms iteration = 28 status = {}
25702024-12-12T04:17:14.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25712024-12-12T04:17:14.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25722024-12-12T04:17:14.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25732024-12-12T04:17:14.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25742024-12-12T04:17:14.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25752024-12-12T04:17:14.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25762024-12-12T04:17:14.239ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 579.270234ms iteration = 27 status = {}
25772024-12-12T04:17:15.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 05000205-0341-49ff-a94c-6e523da07e4f roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25782024-12-12T04:17:15.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 05000205-0341-49ff-a94c-6e523da07e4f resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25792024-12-12T04:17:15.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2596 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 05000205-0341-49ff-a94c-6e523da07e4f response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25802024-12-12T04:17:16.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 809fd4e4-b50e-4572-b2ec-73732621b73b roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25812024-12-12T04:17:16.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 809fd4e4-b50e-4572-b2ec-73732621b73b resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25822024-12-12T04:17:16.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 809fd4e4-b50e-4572-b2ec-73732621b73b response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25832024-12-12T04:17:17.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 80a624b8-faf6-48b9-9c51-9d52d848390b roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25842024-12-12T04:17:17.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 80a624b8-faf6-48b9-9c51-9d52d848390b resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25852024-12-12T04:17:17.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 80a624b8-faf6-48b9-9c51-9d52d848390b response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25862024-12-12T04:17:18.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 34474eeb-1dba-403a-9949-1efd48c18a6f roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25872024-12-12T04:17:18.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 34474eeb-1dba-403a-9949-1efd48c18a6f resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25882024-12-12T04:17:18.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 34474eeb-1dba-403a-9949-1efd48c18a6f response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25892024-12-12T04:17:19.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2e177dda-c6b0-45a6-ae26-33c542a306db roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25902024-12-12T04:17:19.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2e177dda-c6b0-45a6-ae26-33c542a306db resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25912024-12-12T04:17:19.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2e177dda-c6b0-45a6-ae26-33c542a306db response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25922024-12-12T04:17:20.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9eedca47-779a-4883-bc45-bd3cafef5dd8 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25932024-12-12T04:17:20.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9eedca47-779a-4883-bc45-bd3cafef5dd8 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25942024-12-12T04:17:20.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2660 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 9eedca47-779a-4883-bc45-bd3cafef5dd8 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25952024-12-12T04:17:21.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 22278b4a-c1ef-486f-990e-4b06f7d4453c roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25962024-12-12T04:17:21.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 22278b4a-c1ef-486f-990e-4b06f7d4453c resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25972024-12-12T04:17:21.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 22278b4a-c1ef-486f-990e-4b06f7d4453c response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25982024-12-12T04:17:22.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = c4ab1b95-c4b7-45de-b2dd-7cb3e18450ec roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
25992024-12-12T04:17:22.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = c4ab1b95-c4b7-45de-b2dd-7cb3e18450ec resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26002024-12-12T04:17:22.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = c4ab1b95-c4b7-45de-b2dd-7cb3e18450ec response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26012024-12-12T04:17:23.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2d422771-4b6b-41a9-9d11-183000b7563b roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26022024-12-12T04:17:23.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2d422771-4b6b-41a9-9d11-183000b7563b resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26032024-12-12T04:17:23.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2d422771-4b6b-41a9-9d11-183000b7563b response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26042024-12-12T04:17:23.659ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
26052024-12-12T04:17:23.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26062024-12-12T04:17:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26072024-12-12T04:17:23.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
26082024-12-12T04:17:23.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26092024-12-12T04:17:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26102024-12-12T04:17:23.662ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26112024-12-12T04:17:23.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26122024-12-12T04:17:23.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26132024-12-12T04:17:23.663ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.996954ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26142024-12-12T04:17:23.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26152024-12-12T04:17:23.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26162024-12-12T04:17:23.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26172024-12-12T04:17:23.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26182024-12-12T04:17:23.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26192024-12-12T04:17:23.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26202024-12-12T04:17:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
26212024-12-12T04:17:23.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26222024-12-12T04:17:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26232024-12-12T04:17:23.680ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
26242024-12-12T04:17:23.680ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.184687ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
26252024-12-12T04:17:23.909ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 533 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = ff7b209a-ad0e-422d-8106-f543ad0e559e response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
26262024-12-12T04:17:24.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3f779315-9217-4d6f-b5dc-4aeddefdc191 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26272024-12-12T04:17:24.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3f779315-9217-4d6f-b5dc-4aeddefdc191 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26282024-12-12T04:17:24.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 3f779315-9217-4d6f-b5dc-4aeddefdc191 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26292024-12-12T04:17:25.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 719a74e9-e552-497a-a824-924176c3bcd2 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26302024-12-12T04:17:25.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 719a74e9-e552-497a-a824-924176c3bcd2 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26312024-12-12T04:17:25.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 719a74e9-e552-497a-a824-924176c3bcd2 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26322024-12-12T04:17:26.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = c900d836-addb-458c-a7c2-0345a50e274d roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26332024-12-12T04:17:26.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = c900d836-addb-458c-a7c2-0345a50e274d resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26342024-12-12T04:17:26.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = c900d836-addb-458c-a7c2-0345a50e274d response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26352024-12-12T04:17:27.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 6e75b3eb-d9f2-413a-a590-2d9d1380148d roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26362024-12-12T04:17:27.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 6e75b3eb-d9f2-413a-a590-2d9d1380148d resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26372024-12-12T04:17:27.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 6e75b3eb-d9f2-413a-a590-2d9d1380148d response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26382024-12-12T04:17:28.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2bf325b4-141f-4ac5-8c54-b9f4a8530c74 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26392024-12-12T04:17:28.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2bf325b4-141f-4ac5-8c54-b9f4a8530c74 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26402024-12-12T04:17:28.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2bf325b4-141f-4ac5-8c54-b9f4a8530c74 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26412024-12-12T04:17:29.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b8862203-0202-4113-9363-747720013a13 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26422024-12-12T04:17:29.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b8862203-0202-4113-9363-747720013a13 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26432024-12-12T04:17:29.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b8862203-0202-4113-9363-747720013a13 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26442024-12-12T04:17:30.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = f3c1211b-7b50-4476-a9a0-a60c1996f5be roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26452024-12-12T04:17:30.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = f3c1211b-7b50-4476-a9a0-a60c1996f5be resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26462024-12-12T04:17:30.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = f3c1211b-7b50-4476-a9a0-a60c1996f5be response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26472024-12-12T04:17:31.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b80c417b-c944-46c8-8600-eebd3681e962 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26482024-12-12T04:17:31.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b80c417b-c944-46c8-8600-eebd3681e962 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26492024-12-12T04:17:31.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = b80c417b-c944-46c8-8600-eebd3681e962 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26502024-12-12T04:17:32.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 995b7250-35cc-4a66-bb90-5929f3d04150 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26512024-12-12T04:17:32.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 995b7250-35cc-4a66-bb90-5929f3d04150 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26522024-12-12T04:17:32.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 995b7250-35cc-4a66-bb90-5929f3d04150 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26532024-12-12T04:17:33.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e7900d88-1dd4-420c-9240-25d99c1198b3 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26542024-12-12T04:17:33.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e7900d88-1dd4-420c-9240-25d99c1198b3 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26552024-12-12T04:17:33.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e7900d88-1dd4-420c-9240-25d99c1198b3 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26562024-12-12T04:17:33.659ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
26572024-12-12T04:17:33.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26582024-12-12T04:17:33.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26592024-12-12T04:17:33.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
26602024-12-12T04:17:33.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26612024-12-12T04:17:33.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26622024-12-12T04:17:33.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26632024-12-12T04:17:33.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26642024-12-12T04:17:33.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26652024-12-12T04:17:33.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26662024-12-12T04:17:33.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26672024-12-12T04:17:33.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26682024-12-12T04:17:33.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26692024-12-12T04:17:33.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
26702024-12-12T04:17:33.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26712024-12-12T04:17:33.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26722024-12-12T04:17:33.679ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
26732024-12-12T04:17:33.679ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.235089ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
26742024-12-12T04:17:33.690ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26752024-12-12T04:17:33.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26762024-12-12T04:17:33.716ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.18691ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26772024-12-12T04:17:33.910ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 969 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = 9439c1e4-088b-4909-a1e2-9b732697f5e6 response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
26782024-12-12T04:17:34.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4e972ab9-ba52-4f8c-a5c3-be0fe88afef5 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26792024-12-12T04:17:34.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4e972ab9-ba52-4f8c-a5c3-be0fe88afef5 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26802024-12-12T04:17:34.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4e972ab9-ba52-4f8c-a5c3-be0fe88afef5 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26812024-12-12T04:17:35.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5007b4a0-da93-409f-81cf-dc447a672bdb roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26822024-12-12T04:17:35.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5007b4a0-da93-409f-81cf-dc447a672bdb resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26832024-12-12T04:17:35.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5007b4a0-da93-409f-81cf-dc447a672bdb response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26842024-12-12T04:17:36.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = db04fdf9-b3ab-4690-be9c-4ed11e754306 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26852024-12-12T04:17:36.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = db04fdf9-b3ab-4690-be9c-4ed11e754306 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26862024-12-12T04:17:36.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = db04fdf9-b3ab-4690-be9c-4ed11e754306 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26872024-12-12T04:17:37.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = c1d6e758-3314-437c-8526-36fe67d139f2 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26882024-12-12T04:17:37.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = c1d6e758-3314-437c-8526-36fe67d139f2 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26892024-12-12T04:17:37.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = c1d6e758-3314-437c-8526-36fe67d139f2 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26902024-12-12T04:17:38.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 23d4e762-e1c3-4a81-bd22-fbf0458d38b1 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26912024-12-12T04:17:38.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 23d4e762-e1c3-4a81-bd22-fbf0458d38b1 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26922024-12-12T04:17:38.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 23d4e762-e1c3-4a81-bd22-fbf0458d38b1 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
26932024-12-12T04:17:38.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 8a6849b7-bf6b-4d83-9df6-fef77845c29e roles = RoleSet { roles: {} } uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?sort_by=id_ascending
26942024-12-12T04:17:38.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 8a6849b7-bf6b-4d83-9df6-fef77845c29e resource = Database result = Ok(()) uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?sort_by=id_ascending
26952024-12-12T04:17:38.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = 8a6849b7-bf6b-4d83-9df6-fef77845c29e response_code = 200 uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?sort_by=id_ascending
26962024-12-12T04:17:38.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = c097e954-d61b-4834-b011-644c74f7777d roles = RoleSet { roles: {} } uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYWFmOWFmNi0xYTg2LTQ5MGUtYjI1Zi02YWUwZWQ0MTkxMjEifX0%3D
26972024-12-12T04:17:38.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = c097e954-d61b-4834-b011-644c74f7777d resource = Database result = Ok(()) uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYWFmOWFmNi0xYTg2LTQ5MGUtYjI1Zi02YWUwZWQ0MTkxMjEifX0%3D
26982024-12-12T04:17:38.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2751 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51795 req_id = c097e954-d61b-4834-b011-644c74f7777d response_code = 200 uri = /metrics/collectors/987cdbf0-9703-44d8-809c-7fc661879e56/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYWFmOWFmNi0xYTg2LTQ5MGUtYjI1Zi02YWUwZWQ0MTkxMjEifX0%3D
26992024-12-12T04:17:39.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 87b55276-de9f-48b4-8c34-6dc7986e6ef0 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
27002024-12-12T04:17:39.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 87b55276-de9f-48b4-8c34-6dc7986e6ef0 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
27012024-12-12T04:17:39.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2738 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 87b55276-de9f-48b4-8c34-6dc7986e6ef0 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
27022024-12-12T04:17:40.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = c70e3c66-e122-4a73-ae0e-f5fc472ffc4c roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
27032024-12-12T04:17:40.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = c70e3c66-e122-4a73-ae0e-f5fc472ffc4c resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
27042024-12-12T04:17:40.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = c70e3c66-e122-4a73-ae0e-f5fc472ffc4c response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
27052024-12-12T04:17:41.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = ae734737-2453-4153-86db-1a1c3257ad77 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
27062024-12-12T04:17:41.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = ae734737-2453-4153-86db-1a1c3257ad77 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
27072024-12-12T04:17:41.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = ae734737-2453-4153-86db-1a1c3257ad77 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
27082024-12-12T04:17:42.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8e208729-15ce-4496-8478-a907b79dfe80 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
27092024-12-12T04:17:42.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8e208729-15ce-4496-8478-a907b79dfe80 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
27102024-12-12T04:17:42.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8e208729-15ce-4496-8478-a907b79dfe80 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
27112024-12-12T04:17:43.659ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
27122024-12-12T04:17:43.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
27132024-12-12T04:17:43.659ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
27142024-12-12T04:17:43.659ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
27152024-12-12T04:17:43.659ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27162024-12-12T04:17:43.659ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27172024-12-12T04:17:43.659ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
27182024-12-12T04:17:43.659ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
27192024-12-12T04:17:43.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27202024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
27212024-12-12T04:17:43.660ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
27222024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27232024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
27242024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
27252024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
27262024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27272024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
27282024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27292024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
27302024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27312024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27322024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27332024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27342024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
27352024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27362024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27372024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27382024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27392024-12-12T04:17:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27402024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
27412024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
27422024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
27432024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27442024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
27452024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
27462024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27472024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
27482024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27492024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
27502024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27512024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
27522024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27532024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
27542024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27552024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27562024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27572024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27582024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27592024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27602024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27612024-12-12T04:17:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27622024-12-12T04:17:43.662ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.746629ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27632024-12-12T04:17:43.662ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27642024-12-12T04:17:43.662ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4496, tv_nsec: 467324344 } })
27652024-12-12T04:17:43.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27662024-12-12T04:17:43.663ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
27672024-12-12T04:17:43.663ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27682024-12-12T04:17:43.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27692024-12-12T04:17:43.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27702024-12-12T04:17:43.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27712024-12-12T04:17:43.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27722024-12-12T04:17:43.666ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27732024-12-12T04:17:43.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27742024-12-12T04:17:43.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27752024-12-12T04:17:43.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27762024-12-12T04:17:43.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27772024-12-12T04:17:43.669ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27782024-12-12T04:17:43.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27792024-12-12T04:17:43.670ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27802024-12-12T04:17:43.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27812024-12-12T04:17:43.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27822024-12-12T04:17:43.671ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27832024-12-12T04:17:43.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27842024-12-12T04:17:43.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27852024-12-12T04:17:43.672ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27862024-12-12T04:17:43.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27872024-12-12T04:17:43.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27882024-12-12T04:17:43.676ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 16.569ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27892024-12-12T04:17:43.677ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4496, tv_nsec: 481937205 } })
27902024-12-12T04:17:43.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27912024-12-12T04:17:43.677ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
27922024-12-12T04:17:43.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27932024-12-12T04:17:43.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27942024-12-12T04:17:43.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27952024-12-12T04:17:43.678ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27962024-12-12T04:17:43.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27972024-12-12T04:17:43.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27982024-12-12T04:17:43.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27992024-12-12T04:17:43.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28002024-12-12T04:17:43.681ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28012024-12-12T04:17:43.682ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4496, tv_nsec: 486696870 } })
28022024-12-12T04:17:43.682ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
28032024-12-12T04:17:43.683ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28042024-12-12T04:17:43.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28052024-12-12T04:17:43.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28062024-12-12T04:17:43.683ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28072024-12-12T04:17:43.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28082024-12-12T04:17:43.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = d7fb9b7c-56fc-4293-9eac-73535e4664a6 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
28092024-12-12T04:17:43.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = d7fb9b7c-56fc-4293-9eac-73535e4664a6 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
28102024-12-12T04:17:43.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = d7fb9b7c-56fc-4293-9eac-73535e4664a6 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
28112024-12-12T04:17:43.693ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 33.467558ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
28122024-12-12T04:17:43.700ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28132024-12-12T04:17:43.700ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
28142024-12-12T04:17:43.700ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28152024-12-12T04:17:43.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28162024-12-12T04:17:43.701ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28172024-12-12T04:17:43.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28182024-12-12T04:17:43.703ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28192024-12-12T04:17:43.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28202024-12-12T04:17:43.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28212024-12-12T04:17:43.708ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.004568ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
28222024-12-12T04:17:43.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80af691a-30bb-4399-8524-a68071b516df, lookup_type: ById(80af691a-30bb-4399-8524-a68071b516df) } result = Ok(())
28232024-12-12T04:17:43.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28242024-12-12T04:17:43.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28252024-12-12T04:17:43.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28262024-12-12T04:17:43.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28272024-12-12T04:17:43.711ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 51.422282ms iteration = 28 status = 0
28282024-12-12T04:17:43.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
28292024-12-12T04:17:43.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28302024-12-12T04:17:43.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28312024-12-12T04:17:43.713ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28322024-12-12T04:17:43.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28332024-12-12T04:17:43.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28342024-12-12T04:17:43.713ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28352024-12-12T04:17:43.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28362024-12-12T04:17:43.717ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28372024-12-12T04:17:43.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28382024-12-12T04:17:43.720ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28392024-12-12T04:17:43.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28402024-12-12T04:17:43.725ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
28412024-12-12T04:17:43.725ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.592291ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
28422024-12-12T04:17:43.725ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28432024-12-12T04:17:43.725ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28442024-12-12T04:17:43.726ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "05a8f748-1b64-4199-a602-be664e4f71aa", "content-length": "26", "date": "Thu, 12 Dec 2024 04:17:42 GMT"} })
28452024-12-12T04:17:43.726ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28462024-12-12T04:17:43.728ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28472024-12-12T04:17:43.728ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28482024-12-12T04:17:43.728ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.801702ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28492024-12-12T04:17:43.737ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28502024-12-12T04:17:43.737ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28512024-12-12T04:17:43.737ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28522024-12-12T04:17:43.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28532024-12-12T04:17:43.746ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28542024-12-12T04:17:43.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28552024-12-12T04:17:43.748ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 87.741263ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
28562024-12-12T04:17:43.749ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28572024-12-12T04:17:43.749ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28582024-12-12T04:17:43.749ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22cd4731-59e3-4378-b92e-1ac3f03ce995", "content-length": "26", "date": "Thu, 12 Dec 2024 04:17:42 GMT"} })
28592024-12-12T04:17:43.750ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28602024-12-12T04:17:43.751ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28612024-12-12T04:17:43.754ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e zone_address = fd00:1122:3344:101::2
28622024-12-12T04:17:43.754ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28632024-12-12T04:17:43.754ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5f59db0-25e1-4929-9d0a-0ab6361810a5", "content-length": "26", "date": "Thu, 12 Dec 2024 04:17:42 GMT"} })
28642024-12-12T04:17:43.754ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28652024-12-12T04:17:43.757ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
28662024-12-12T04:17:43.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 101.618914ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28672024-12-12T04:17:43.780ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 118.997936ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
28682024-12-12T04:17:43.781ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28692024-12-12T04:17:43.781ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28702024-12-12T04:17:43.781ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 120.307652ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28712024-12-12T04:17:43.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28722024-12-12T04:17:43.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28732024-12-12T04:17:43.785ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 125.162791ms iteration = 31 status = {"physical_disks_added":0}
28742024-12-12T04:17:43.785ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28752024-12-12T04:17:43.787ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28762024-12-12T04:17:43.787ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28772024-12-12T04:17:43.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28782024-12-12T04:17:43.800ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28792024-12-12T04:17:43.800ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b3bb60e-1029-4f16-8ff7-a53d2faeb2c6", "content-length": "2", "date": "Thu, 12 Dec 2024 04:17:43 GMT"} })
28802024-12-12T04:17:43.802ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28812024-12-12T04:17:43.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28822024-12-12T04:17:43.842ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 181.483948ms iteration = 28 status = {}
28832024-12-12T04:17:43.866ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28842024-12-12T04:17:43.866ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28852024-12-12T04:17:43.867ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "611fcf58-e6f2-4cf2-9b05-e59569e68ad7", "content-length": "372", "date": "Thu, 12 Dec 2024 04:17:43 GMT"} })
28862024-12-12T04:17:43.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28872024-12-12T04:17:43.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28882024-12-12T04:17:43.869ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 210.051239ms iteration = 28 status = null
28892024-12-12T04:17:43.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28902024-12-12T04:17:43.902ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28912024-12-12T04:17:43.902ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28922024-12-12T04:17:43.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28932024-12-12T04:17:43.908ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 496 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = 13f9f288-eacc-4007-9ce4-045273e9115d response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
28942024-12-12T04:17:43.915ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
28952024-12-12T04:17:43.915ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28962024-12-12T04:17:43.915ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "77884f72-78f8-4690-af51-bf3a86b98b47", "date": "Thu, 12 Dec 2024 04:17:43 GMT"} })
28972024-12-12T04:17:43.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28982024-12-12T04:17:43.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28992024-12-12T04:17:43.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29002024-12-12T04:17:43.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29012024-12-12T04:17:43.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29022024-12-12T04:17:43.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29032024-12-12T04:17:43.925ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29042024-12-12T04:17:43.925ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29052024-12-12T04:17:43.925ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "306b85e3-de7a-437f-addb-7672823ed265", "date": "Thu, 12 Dec 2024 04:17:43 GMT"} })
29062024-12-12T04:17:43.927ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 267.552479ms iteration = 29 status = {}
29072024-12-12T04:17:43.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29082024-12-12T04:17:43.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29092024-12-12T04:17:43.954ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29102024-12-12T04:17:43.954ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "20774c5e-6cb0-4f74-a5fa-733c7298acaa", "content-length": "691", "date": "Thu, 12 Dec 2024 04:17:43 GMT"} })
29112024-12-12T04:17:43.954ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
29122024-12-12T04:17:43.954ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
29132024-12-12T04:17:43.954ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
29142024-12-12T04:17:43.955ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 295.215131ms iteration = 29 status = {}
29152024-12-12T04:17:43.955ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c4635247-5d4b-4f7c-ae5e-b1d4df6bd7b3, rack_id: 1612ec8d-a72c-445a-999f-274daa8c155e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(16ab99da-4da3-4a67-a57e-4d569b0ca16d) } rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0
29162024-12-12T04:17:43.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29172024-12-12T04:17:43.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29182024-12-12T04:17:43.964ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29192024-12-12T04:17:43.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5369084c-61cf-4b55-af76-2a516bbb0570", "content-length": "134", "date": "Thu, 12 Dec 2024 04:17:43 GMT"} })
29202024-12-12T04:17:43.964ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
29212024-12-12T04:17:43.964ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 16ab99da-4da3-4a67-a57e-4d569b0ca16d
29222024-12-12T04:17:43.965ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29232024-12-12T04:17:43.965ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29242024-12-12T04:17:43.965ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29252024-12-12T04:17:43.965ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29262024-12-12T04:17:43.965ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29272024-12-12T04:17:43.965ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29282024-12-12T04:17:43.965ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29292024-12-12T04:17:43.965ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29302024-12-12T04:17:43.965ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
29312024-12-12T04:17:43.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29322024-12-12T04:17:43.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29332024-12-12T04:17:43.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29342024-12-12T04:17:43.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "738fd18a-9e5c-451b-97a6-456bd41fbdce", "content-length": "2", "date": "Thu, 12 Dec 2024 04:17:43 GMT"} })
29352024-12-12T04:17:43.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29362024-12-12T04:17:43.968ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "214018a1-fa78-46e1-809d-50b31a14f966", "content-length": "52", "date": "Thu, 12 Dec 2024 04:17:43 GMT"} })
29372024-12-12T04:17:43.968ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0
29382024-12-12T04:17:43.968ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29392024-12-12T04:17:44.056ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "577fb718-4718-4dfc-8736-68c2cf2166c7", "date": "Thu, 12 Dec 2024 04:17:43 GMT"} })
29402024-12-12T04:17:44.056ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch = Switch0
29412024-12-12T04:17:44.056ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29422024-12-12T04:17:44.056ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "222c1199-1ba5-4b9a-8a74-2cc0d4eda21c", "content-length": "682", "date": "Thu, 12 Dec 2024 04:17:43 GMT"} })
29432024-12-12T04:17:44.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29442024-12-12T04:17:44.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29452024-12-12T04:17:44.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29462024-12-12T04:17:44.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29472024-12-12T04:17:44.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29482024-12-12T04:17:44.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29492024-12-12T04:17:44.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29502024-12-12T04:17:44.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29512024-12-12T04:17:44.073ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 413.646355ms iteration = 28 status = {}
29522024-12-12T04:17:44.638ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
29532024-12-12T04:17:44.638ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
29542024-12-12T04:17:44.669ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
29552024-12-12T04:17:44.669ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:65313
29562024-12-12T04:17:44.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65313 req_id = eebeb6c4-efd6-4cdd-a6ed-5a19ef541f69 roles = RoleSet { roles: {} } uri = /metrics/producers
29572024-12-12T04:17:44.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65313 req_id = eebeb6c4-efd6-4cdd-a6ed-5a19ef541f69 resource = Database result = Ok(()) uri = /metrics/producers
29582024-12-12T04:17:44.702ZINFOnexus: assigned collector to new producer collector_id = 987cdbf0-9703-44d8-809c-7fc661879e56 file = nexus/src/app/oximeter.rs:76 producer_id = 4a50bf12-1fdc-4917-8d03-ca85c9fb72af
29592024-12-12T04:17:44.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33465 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65313 req_id = eebeb6c4-efd6-4cdd-a6ed-5a19ef541f69 response_code = 201 uri = /metrics/producers
29602024-12-12T04:17:44.703ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "eebeb6c4-efd6-4cdd-a6ed-5a19ef541f69", "content-length": "41", "date": "Thu, 12 Dec 2024 04:17:44 GMT"} })
29612024-12-12T04:17:44.704ZDEBGnexus (producer-registration-task): registered with nexus successfully
29622024-12-12T04:17:44.704ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
29632024-12-12T04:17:44.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = fba74fe2-5c91-46e3-97e7-9d3bb7335ec8 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29642024-12-12T04:17:44.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = fba74fe2-5c91-46e3-97e7-9d3bb7335ec8 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29652024-12-12T04:17:44.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = fba74fe2-5c91-46e3-97e7-9d3bb7335ec8 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29662024-12-12T04:17:45.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 06ab0cd7-33f1-44c9-bb2b-1fe41783d51c roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29672024-12-12T04:17:45.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 06ab0cd7-33f1-44c9-bb2b-1fe41783d51c resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29682024-12-12T04:17:45.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 06ab0cd7-33f1-44c9-bb2b-1fe41783d51c response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29692024-12-12T04:17:46.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a7f68c97-c51a-4dfb-8bc5-b8318e67c357 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29702024-12-12T04:17:46.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a7f68c97-c51a-4dfb-8bc5-b8318e67c357 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29712024-12-12T04:17:46.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a7f68c97-c51a-4dfb-8bc5-b8318e67c357 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29722024-12-12T04:17:47.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = fe9ce82f-0bea-41a6-b1ad-22f19b4b1970 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29732024-12-12T04:17:47.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = fe9ce82f-0bea-41a6-b1ad-22f19b4b1970 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29742024-12-12T04:17:47.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = fe9ce82f-0bea-41a6-b1ad-22f19b4b1970 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29752024-12-12T04:17:48.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 69f6d683-3157-4e3d-bef5-161ea3831634 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29762024-12-12T04:17:48.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 69f6d683-3157-4e3d-bef5-161ea3831634 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29772024-12-12T04:17:48.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 69f6d683-3157-4e3d-bef5-161ea3831634 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29782024-12-12T04:17:49.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = abe8e149-d615-450a-a637-f06a988a66f8 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29792024-12-12T04:17:49.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = abe8e149-d615-450a-a637-f06a988a66f8 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29802024-12-12T04:17:49.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = abe8e149-d615-450a-a637-f06a988a66f8 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29812024-12-12T04:17:50.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 915af87d-2c94-461d-ab71-aa9654cfde1b roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29822024-12-12T04:17:50.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 915af87d-2c94-461d-ab71-aa9654cfde1b resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29832024-12-12T04:17:50.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 915af87d-2c94-461d-ab71-aa9654cfde1b response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29842024-12-12T04:17:51.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2828a7da-df87-46ec-8b3d-23264991c60d roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29852024-12-12T04:17:51.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2828a7da-df87-46ec-8b3d-23264991c60d resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29862024-12-12T04:17:51.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2828a7da-df87-46ec-8b3d-23264991c60d response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29872024-12-12T04:17:52.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a7abc1ca-74db-4b4d-96fa-739e64be5a31 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29882024-12-12T04:17:52.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a7abc1ca-74db-4b4d-96fa-739e64be5a31 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29892024-12-12T04:17:52.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a7abc1ca-74db-4b4d-96fa-739e64be5a31 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
29902024-12-12T04:17:53.660ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
29912024-12-12T04:17:53.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29922024-12-12T04:17:53.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29932024-12-12T04:17:53.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
29942024-12-12T04:17:53.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29952024-12-12T04:17:53.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29962024-12-12T04:17:53.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29972024-12-12T04:17:53.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29982024-12-12T04:17:53.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29992024-12-12T04:17:53.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30002024-12-12T04:17:53.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30012024-12-12T04:17:53.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30022024-12-12T04:17:53.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30032024-12-12T04:17:53.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
30042024-12-12T04:17:53.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30052024-12-12T04:17:53.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30062024-12-12T04:17:53.683ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
30072024-12-12T04:17:53.683ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.459658ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
30082024-12-12T04:17:53.689ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30092024-12-12T04:17:53.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30102024-12-12T04:17:53.725ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.411717ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30112024-12-12T04:17:53.909ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 520 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = 664249b4-4e22-493f-bca8-928b3b5f4d5b response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
30122024-12-12T04:17:53.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e1c3f5ed-09b3-4261-8bb5-c0bec91f3649 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30132024-12-12T04:17:53.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e1c3f5ed-09b3-4261-8bb5-c0bec91f3649 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30142024-12-12T04:17:53.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e1c3f5ed-09b3-4261-8bb5-c0bec91f3649 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30152024-12-12T04:17:54.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 6a7927fc-1f6d-43df-93e1-a0f196dce731 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30162024-12-12T04:17:54.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 6a7927fc-1f6d-43df-93e1-a0f196dce731 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30172024-12-12T04:17:54.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 6a7927fc-1f6d-43df-93e1-a0f196dce731 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30182024-12-12T04:17:55.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 290353ba-6b3e-4aa7-a696-820d40038535 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30192024-12-12T04:17:55.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 290353ba-6b3e-4aa7-a696-820d40038535 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30202024-12-12T04:17:55.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 290353ba-6b3e-4aa7-a696-820d40038535 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30212024-12-12T04:17:57.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 267543b0-035d-4155-bec3-335f5f145317 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30222024-12-12T04:17:57.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 267543b0-035d-4155-bec3-335f5f145317 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30232024-12-12T04:17:57.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 267543b0-035d-4155-bec3-335f5f145317 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30242024-12-12T04:17:58.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a9bb443a-4d7d-49b8-9e40-dd9041098f6a roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30252024-12-12T04:17:58.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a9bb443a-4d7d-49b8-9e40-dd9041098f6a resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30262024-12-12T04:17:58.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a9bb443a-4d7d-49b8-9e40-dd9041098f6a response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30272024-12-12T04:17:59.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 873b3f40-43e3-4392-a31b-73d3b6bc758d roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30282024-12-12T04:17:59.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 873b3f40-43e3-4392-a31b-73d3b6bc758d resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30292024-12-12T04:17:59.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 873b3f40-43e3-4392-a31b-73d3b6bc758d response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30302024-12-12T04:18:00.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4cbc107a-640f-49c7-a229-42cb629dc6d6 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30312024-12-12T04:18:00.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4cbc107a-640f-49c7-a229-42cb629dc6d6 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30322024-12-12T04:18:00.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4cbc107a-640f-49c7-a229-42cb629dc6d6 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30332024-12-12T04:18:01.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4d9e6dba-8ce2-4df6-94f8-125eb58064d2 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30342024-12-12T04:18:01.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4d9e6dba-8ce2-4df6-94f8-125eb58064d2 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30352024-12-12T04:18:01.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 4d9e6dba-8ce2-4df6-94f8-125eb58064d2 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30362024-12-12T04:18:02.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 662ad63c-94c7-41ba-b95c-c9da5575e70b roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30372024-12-12T04:18:02.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 662ad63c-94c7-41ba-b95c-c9da5575e70b resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30382024-12-12T04:18:02.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 662ad63c-94c7-41ba-b95c-c9da5575e70b response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30392024-12-12T04:18:03.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a488085f-5992-4f56-b520-98c15a03193a roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30402024-12-12T04:18:03.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a488085f-5992-4f56-b520-98c15a03193a resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30412024-12-12T04:18:03.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = a488085f-5992-4f56-b520-98c15a03193a response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30422024-12-12T04:18:03.660ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
30432024-12-12T04:18:03.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30442024-12-12T04:18:03.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30452024-12-12T04:18:03.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
30462024-12-12T04:18:03.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30472024-12-12T04:18:03.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30482024-12-12T04:18:03.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30492024-12-12T04:18:03.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30502024-12-12T04:18:03.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30512024-12-12T04:18:03.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30522024-12-12T04:18:03.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30532024-12-12T04:18:03.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30542024-12-12T04:18:03.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30552024-12-12T04:18:03.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
30562024-12-12T04:18:03.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30572024-12-12T04:18:03.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30582024-12-12T04:18:03.684ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
30592024-12-12T04:18:03.684ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.713606ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
30602024-12-12T04:18:03.689ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30612024-12-12T04:18:03.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30622024-12-12T04:18:03.717ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.295693ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30632024-12-12T04:18:03.909ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 858 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = 901dca03-aae1-43a7-b67c-8e6bdf2e339a response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
30642024-12-12T04:18:04.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 42bad996-afba-4b7e-9c09-8930d4106036 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30652024-12-12T04:18:04.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 42bad996-afba-4b7e-9c09-8930d4106036 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30662024-12-12T04:18:04.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 42bad996-afba-4b7e-9c09-8930d4106036 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30672024-12-12T04:18:05.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7caace25-26a6-4670-a3a2-095c1d09144c roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30682024-12-12T04:18:05.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7caace25-26a6-4670-a3a2-095c1d09144c resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30692024-12-12T04:18:05.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7caace25-26a6-4670-a3a2-095c1d09144c response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30702024-12-12T04:18:06.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8c81a0dc-8655-4579-b446-60342f14aad2 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30712024-12-12T04:18:06.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8c81a0dc-8655-4579-b446-60342f14aad2 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30722024-12-12T04:18:06.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 8c81a0dc-8655-4579-b446-60342f14aad2 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30732024-12-12T04:18:07.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 000fcb06-adb0-433a-ac6e-1662b993cbfc roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30742024-12-12T04:18:07.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 000fcb06-adb0-433a-ac6e-1662b993cbfc resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30752024-12-12T04:18:07.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 000fcb06-adb0-433a-ac6e-1662b993cbfc response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30762024-12-12T04:18:08.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e74b903d-9495-4feb-a8cc-7f2fafa92006 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30772024-12-12T04:18:08.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e74b903d-9495-4feb-a8cc-7f2fafa92006 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30782024-12-12T04:18:08.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = e74b903d-9495-4feb-a8cc-7f2fafa92006 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30792024-12-12T04:18:09.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5e23a3a1-4722-4817-9078-da766ffad139 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30802024-12-12T04:18:09.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5e23a3a1-4722-4817-9078-da766ffad139 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30812024-12-12T04:18:09.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5e23a3a1-4722-4817-9078-da766ffad139 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30822024-12-12T04:18:10.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = ba4ad96d-ae73-4fe9-b40b-4c6db6bf66f0 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30832024-12-12T04:18:10.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = ba4ad96d-ae73-4fe9-b40b-4c6db6bf66f0 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30842024-12-12T04:18:10.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = ba4ad96d-ae73-4fe9-b40b-4c6db6bf66f0 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30852024-12-12T04:18:11.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = eb7537d4-a316-4d69-bde1-7c64971afc34 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30862024-12-12T04:18:11.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = eb7537d4-a316-4d69-bde1-7c64971afc34 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30872024-12-12T04:18:11.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = eb7537d4-a316-4d69-bde1-7c64971afc34 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30882024-12-12T04:18:12.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5aebd3bd-37e5-481f-b502-6f10b7f98e30 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30892024-12-12T04:18:12.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5aebd3bd-37e5-481f-b502-6f10b7f98e30 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30902024-12-12T04:18:12.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 5aebd3bd-37e5-481f-b502-6f10b7f98e30 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30912024-12-12T04:18:13.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = da78e6c4-6f0f-42e6-bff1-88b6bf269865 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30922024-12-12T04:18:13.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = da78e6c4-6f0f-42e6-bff1-88b6bf269865 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30932024-12-12T04:18:13.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = da78e6c4-6f0f-42e6-bff1-88b6bf269865 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
30942024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
30952024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
30962024-12-12T04:18:13.660ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
30972024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
30982024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
30992024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31002024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31012024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
31022024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31032024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
31042024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31052024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
31062024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
31072024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
31082024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
31092024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
31102024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31112024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
31122024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31132024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
31142024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
31152024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
31162024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
31172024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31182024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
31192024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
31202024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
31212024-12-12T04:18:13.660ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
31222024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31232024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
31242024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31252024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31262024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31272024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
31282024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31292024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31302024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31312024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31322024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
31332024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
31342024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31352024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
31362024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
31372024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31382024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31392024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
31402024-12-12T04:18:13.660ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1fe61f23-9928-4fa9-a236-a7026965e207
31412024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
31422024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
31432024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.641\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"1fe61f23-9928-4fa9-a236-a7026965e207"}
31442024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31452024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
31462024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
31472024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
31482024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
31492024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
31502024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31512024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31522024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31532024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
31542024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31552024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
31562024-12-12T04:18:13.660ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-12 04:08:13.660679516 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
31572024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
31582024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31592024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
31602024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31612024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
31622024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31632024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31642024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
31652024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31662024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31672024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31682024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31692024-12-12T04:18:13.660ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bb732d7-5c6c-418e-9bb4-2b78363c496b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a6e7ea12-5d7a-4497-b4c7-99b34dca3373.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a6e7ea12-5d7a-4497-b4c7-99b34dca3373.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 4526, tv_nsec: 465304567 } })
31702024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31712024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31722024-12-12T04:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31732024-12-12T04:18:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31742024-12-12T04:18:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31752024-12-12T04:18:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31762024-12-12T04:18:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31772024-12-12T04:18:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31782024-12-12T04:18:13.661ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("68b92f4b-c208-4567-8395-96046a9b6c9a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c9c9afd6-aa03-4a96-8241-6ae7ccfbce28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d24a9d9f-7884-44e6-bf52-febe49c3b719.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d24a9d9f-7884-44e6-bf52-febe49c3b719.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 4526, tv_nsec: 465605232 } })
31792024-12-12T04:18:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31802024-12-12T04:18:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31812024-12-12T04:18:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
31822024-12-12T04:18:13.661ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
31832024-12-12T04:18:13.661ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.164002ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
31842024-12-12T04:18:13.661ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
31852024-12-12T04:18:13.661ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 960.405\u{b5}s iteration = 15 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
31862024-12-12T04:18:13.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31872024-12-12T04:18:13.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31882024-12-12T04:18:13.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31892024-12-12T04:18:13.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31902024-12-12T04:18:13.664ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.220918ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31912024-12-12T04:18:13.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31922024-12-12T04:18:13.666ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.308485ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
31932024-12-12T04:18:13.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31942024-12-12T04:18:13.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31952024-12-12T04:18:13.667ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31962024-12-12T04:18:13.668ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
31972024-12-12T04:18:13.668ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
31982024-12-12T04:18:13.668ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 8.595236ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
31992024-12-12T04:18:13.669ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4526, tv_nsec: 474261068 } })
32002024-12-12T04:18:13.670ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
32012024-12-12T04:18:13.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
32022024-12-12T04:18:13.670ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32032024-12-12T04:18:13.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32042024-12-12T04:18:13.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32052024-12-12T04:18:13.670ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32062024-12-12T04:18:13.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32072024-12-12T04:18:13.671ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32082024-12-12T04:18:13.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32092024-12-12T04:18:13.676ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4526, tv_nsec: 480957605 } })
32102024-12-12T04:18:13.676ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
32112024-12-12T04:18:13.678ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32122024-12-12T04:18:13.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32132024-12-12T04:18:13.679ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32142024-12-12T04:18:13.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32152024-12-12T04:18:13.680ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-12 04:08:13.660679516 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32162024-12-12T04:18:13.680ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.540982ms iteration = 15 status = {"expiration":"2024-12-12T04:08:13.660679516Z","pruned":[]}
32172024-12-12T04:18:13.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32182024-12-12T04:18:13.682ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32192024-12-12T04:18:13.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32202024-12-12T04:18:13.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32212024-12-12T04:18:13.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32222024-12-12T04:18:13.684ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32232024-12-12T04:18:13.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32242024-12-12T04:18:13.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32252024-12-12T04:18:13.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32262024-12-12T04:18:13.710ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.344564ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
32272024-12-12T04:18:13.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32282024-12-12T04:18:13.711ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32292024-12-12T04:18:13.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32302024-12-12T04:18:13.714ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32312024-12-12T04:18:13.714ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
32322024-12-12T04:18:13.714ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32332024-12-12T04:18:13.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32342024-12-12T04:18:13.715ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.443245ms iteration = 29 status = {"errors":[],"records_set_to_done":[]}
32352024-12-12T04:18:13.718ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32362024-12-12T04:18:13.718ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32372024-12-12T04:18:13.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32382024-12-12T04:18:13.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32392024-12-12T04:18:13.718ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32402024-12-12T04:18:13.719ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32412024-12-12T04:18:13.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32422024-12-12T04:18:13.721ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32432024-12-12T04:18:13.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32442024-12-12T04:18:13.722ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32452024-12-12T04:18:13.722ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32462024-12-12T04:18:13.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32472024-12-12T04:18:13.724ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
32482024-12-12T04:18:13.724ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
32492024-12-12T04:18:13.724ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 64.636782ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
32502024-12-12T04:18:13.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32512024-12-12T04:18:13.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32522024-12-12T04:18:13.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32532024-12-12T04:18:13.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32542024-12-12T04:18:13.729ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32552024-12-12T04:18:13.730ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32562024-12-12T04:18:13.730ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.231545ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32572024-12-12T04:18:13.731ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
32582024-12-12T04:18:13.731ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
32592024-12-12T04:18:13.731ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
32602024-12-12T04:18:13.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32612024-12-12T04:18:13.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32622024-12-12T04:18:13.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32632024-12-12T04:18:13.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32642024-12-12T04:18:13.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32652024-12-12T04:18:13.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32662024-12-12T04:18:13.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32672024-12-12T04:18:13.743ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32682024-12-12T04:18:13.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32692024-12-12T04:18:13.763ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
32702024-12-12T04:18:13.763ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
32712024-12-12T04:18:13.763ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
32722024-12-12T04:18:13.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32732024-12-12T04:18:13.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32742024-12-12T04:18:13.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32752024-12-12T04:18:13.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32762024-12-12T04:18:13.791ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
32772024-12-12T04:18:13.798ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
32782024-12-12T04:18:13.809ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
32792024-12-12T04:18:13.809ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32802024-12-12T04:18:13.810ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d54a114-b861-4aab-9793-b1ef78bfa2c5", "content-length": "26", "date": "Thu, 12 Dec 2024 04:18:12 GMT"} })
32812024-12-12T04:18:13.810ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32822024-12-12T04:18:13.811ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32832024-12-12T04:18:13.824ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
32842024-12-12T04:18:13.824ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32852024-12-12T04:18:13.824ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9ae6208-2495-4ccf-b6c5-0e721b570df6", "content-length": "26", "date": "Thu, 12 Dec 2024 04:18:12 GMT"} })
32862024-12-12T04:18:13.825ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32872024-12-12T04:18:13.826ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32882024-12-12T04:18:13.836ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32892024-12-12T04:18:13.836ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32902024-12-12T04:18:13.837ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d86d286-1feb-433d-8944-a478e74996ed", "content-length": "372", "date": "Thu, 12 Dec 2024 04:18:13 GMT"} })
32912024-12-12T04:18:13.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32922024-12-12T04:18:13.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32932024-12-12T04:18:13.840ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80af691a-30bb-4399-8524-a68071b516df.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4526, tv_nsec: 645221309 } })
32942024-12-12T04:18:13.841ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
32952024-12-12T04:18:13.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32962024-12-12T04:18:13.841ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32972024-12-12T04:18:13.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32982024-12-12T04:18:13.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32992024-12-12T04:18:13.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33002024-12-12T04:18:13.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33012024-12-12T04:18:13.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33022024-12-12T04:18:13.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33032024-12-12T04:18:13.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33042024-12-12T04:18:13.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33052024-12-12T04:18:13.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33062024-12-12T04:18:13.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33072024-12-12T04:18:13.872ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33082024-12-12T04:18:13.873ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 212.461976ms iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
33092024-12-12T04:18:13.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33102024-12-12T04:18:13.875ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33112024-12-12T04:18:13.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 216.013985ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33122024-12-12T04:18:13.876ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33132024-12-12T04:18:13.876ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33142024-12-12T04:18:13.876ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33152024-12-12T04:18:13.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33162024-12-12T04:18:13.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 215.993484ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33172024-12-12T04:18:13.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80af691a-30bb-4399-8524-a68071b516df, lookup_type: ById(80af691a-30bb-4399-8524-a68071b516df) } result = Ok(())
33182024-12-12T04:18:13.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33192024-12-12T04:18:13.878ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33202024-12-12T04:18:13.878ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33212024-12-12T04:18:13.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33222024-12-12T04:18:13.878ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33232024-12-12T04:18:13.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33242024-12-12T04:18:13.881ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 220.810498ms iteration = 29 status = 0
33252024-12-12T04:18:13.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33262024-12-12T04:18:13.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33272024-12-12T04:18:13.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
33282024-12-12T04:18:13.882ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33292024-12-12T04:18:13.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33302024-12-12T04:18:13.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33312024-12-12T04:18:13.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33322024-12-12T04:18:13.884ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
33332024-12-12T04:18:13.884ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 663b0867-5967-4e70-9e4c-e46bea4389d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
33342024-12-12T04:18:13.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33352024-12-12T04:18:13.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33362024-12-12T04:18:13.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33372024-12-12T04:18:13.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1fe61f23-9928-4fa9-a236-a7026965e207, lookup_type: ById(1fe61f23-9928-4fa9-a236-a7026965e207) } result = Ok(())
33382024-12-12T04:18:13.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33392024-12-12T04:18:13.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33402024-12-12T04:18:13.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33412024-12-12T04:18:13.887ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33422024-12-12T04:18:13.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33432024-12-12T04:18:13.900ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
33442024-12-12T04:18:13.900ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
33452024-12-12T04:18:13.900ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fb591340-0284-426c-b454-9b6020c3d652", "date": "Thu, 12 Dec 2024 04:18:13 GMT"} })
33462024-12-12T04:18:13.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33472024-12-12T04:18:13.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33482024-12-12T04:18:13.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33492024-12-12T04:18:13.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33502024-12-12T04:18:13.904ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 original_time_created = 2024-12-12 04:04:04.338768 UTC target_id = 1fe61f23-9928-4fa9-a236-a7026965e207 time_created = 2024-12-12 04:04:04.338768 UTC
33512024-12-12T04:18:13.904ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 244.233231ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1fe61f23-9928-4fa9-a236-a7026965e207","time_created":"2024-12-12T04:04:04.338768Z"}
33522024-12-12T04:18:13.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33532024-12-12T04:18:13.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33542024-12-12T04:18:13.910ZINFOnexus (BackgroundTasks): VPC route manager sled 80af691a-30bb-4399-8524-a68071b516df push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33552024-12-12T04:18:13.910ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33562024-12-12T04:18:13.911ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "821d1c53-e0ac-4b2a-9493-afe57b3b0b4f", "date": "Thu, 12 Dec 2024 04:18:13 GMT"} })
33572024-12-12T04:18:13.912ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1399 local_addr = [fd00:1122:3344:101::c]:47029 method = GET remote_addr = [fd00:1122:3344:101::d]:60284 req_id = 8baaed01-ce2f-4aff-8176-8fb48423aa6d response_code = 200 uri = /4a50bf12-1fdc-4917-8d03-ca85c9fb72af
33582024-12-12T04:18:13.913ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 253.514416ms iteration = 30 status = {}
33592024-12-12T04:18:13.921ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33602024-12-12T04:18:13.921ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33612024-12-12T04:18:13.921ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 260.834699ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
33622024-12-12T04:18:13.927ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 266.945684ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
33632024-12-12T04:18:13.929ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
33642024-12-12T04:18:13.929ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3bc9d287-62fd-4054-a086-452fd6ea3148 dns_zone_name = oxide.test found_so_far = 0 version = 2
33652024-12-12T04:18:13.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33662024-12-12T04:18:13.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33672024-12-12T04:18:13.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33682024-12-12T04:18:13.931ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33692024-12-12T04:18:13.931ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33702024-12-12T04:18:13.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33712024-12-12T04:18:13.932ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
33722024-12-12T04:18:13.932ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
33732024-12-12T04:18:13.932ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c29bd55d-bde1-4c30-8610-6829bbfa6185", "date": "Thu, 12 Dec 2024 04:18:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33742024-12-12T04:18:13.932ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33752024-12-12T04:18:13.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33762024-12-12T04:18:13.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33772024-12-12T04:18:13.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33782024-12-12T04:18:13.934ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "653cccaf-4372-401d-bf43-86b8a81b1b68", "date": "Thu, 12 Dec 2024 04:18:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33792024-12-12T04:18:13.934ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33802024-12-12T04:18:13.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33812024-12-12T04:18:13.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33822024-12-12T04:18:13.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33832024-12-12T04:18:13.936ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33842024-12-12T04:18:13.936ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 276.389465ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
33852024-12-12T04:18:13.937ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 663b0867-5967-4e70-9e4c-e46bea4389d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
33862024-12-12T04:18:13.937ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
33872024-12-12T04:18:13.937ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-12 04:04:17.984914 UTC dns_group = internal generation = 1
33882024-12-12T04:18:13.937ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 277.221854ms iteration = 15 status = {"generation":1}
33892024-12-12T04:18:13.937ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3bc9d287-62fd-4054-a086-452fd6ea3148 dns_zone_name = oxide.test found_so_far = 1 version = 2
33902024-12-12T04:18:13.937ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
33912024-12-12T04:18:13.937ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-12 04:04:19.219093 UTC dns_group = external generation = 2
33922024-12-12T04:18:13.937ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 276.921817ms iteration = 15 status = {"generation":2}
33932024-12-12T04:18:13.951ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
33942024-12-12T04:18:13.951ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 290.408178ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
33952024-12-12T04:18:13.956ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33962024-12-12T04:18:13.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33972024-12-12T04:18:13.968ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33982024-12-12T04:18:13.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33992024-12-12T04:18:13.970ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34002024-12-12T04:18:13.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34012024-12-12T04:18:13.978ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e zone_address = fd00:1122:3344:101::2
34022024-12-12T04:18:13.978ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34032024-12-12T04:18:13.978ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cbf02c4-2aed-4d00-b05e-c7c4af48a7f8", "content-length": "26", "date": "Thu, 12 Dec 2024 04:18:13 GMT"} })
34042024-12-12T04:18:13.978ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34052024-12-12T04:18:13.980ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
34062024-12-12T04:18:13.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34072024-12-12T04:18:13.990ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34082024-12-12T04:18:13.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34092024-12-12T04:18:13.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34102024-12-12T04:18:13.992ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34112024-12-12T04:18:13.994ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34122024-12-12T04:18:13.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34132024-12-12T04:18:13.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34142024-12-12T04:18:13.997ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 337.721616ms iteration = 32 status = {"physical_disks_added":0}
34152024-12-12T04:18:14.003ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-12T04:04:09.118019Z, time_modified: 2024-12-12T04:04:09.118019Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, db_silo: Silo { identity: SiloIdentity { id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T04:04:19.153943Z, time_modified: 2024-12-12T04:04:19.153943Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "f0b8912fb2d95a3478b343431ad55a1239b7666e3e9123bdabc1900b27a1339c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, db_silo: Silo { identity: SiloIdentity { id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T04:04:19.153943Z, time_modified: 2024-12-12T04:04:19.153943Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "f0b8912fb2d95a3478b343431ad55a1239b7666e3e9123bdabc1900b27a1339c" }] }) }
34162024-12-12T04:18:14.003ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 343.167926ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"46bdf509-11b9-47c6-9aa0-67e689dc84db","tls_certs":["f0b8912fb2d95a3478b343431ad55a1239b7666e3e9123bdabc1900b27a1339c"]}},"default_endpoint":{"silo_id":"46bdf509-11b9-47c6-9aa0-67e689dc84db","tls_certs":["f0b8912fb2d95a3478b343431ad55a1239b7666e3e9123bdabc1900b27a1339c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
34172024-12-12T04:18:14.030ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
34182024-12-12T04:18:14.031ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ade92c15-db2e-4db1-b8b7-626582399f3f", "date": "Thu, 12 Dec 2024 04:18:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
34192024-12-12T04:18:14.031ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
34202024-12-12T04:18:14.032ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "befd909d-8468-419b-bf98-7a475709eb1c", "date": "Thu, 12 Dec 2024 04:18:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
34212024-12-12T04:18:14.032ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
34222024-12-12T04:18:14.033ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d299bd79-0206-4c89-8214-235c8cfb65ef", "date": "Thu, 12 Dec 2024 04:18:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
34232024-12-12T04:18:14.034ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
34242024-12-12T04:18:14.035ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
34252024-12-12T04:18:14.035ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 374.978296ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
34262024-12-12T04:18:14.039ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
34272024-12-12T04:18:14.039ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef15741a-be02-40c9-885c-a53055f29e49", "content-length": "2", "date": "Thu, 12 Dec 2024 04:18:13 GMT"} })
34282024-12-12T04:18:14.041ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 381.17242ms iteration = 29 status = {}
34292024-12-12T04:18:14.042ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34302024-12-12T04:18:14.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34312024-12-12T04:18:14.044ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 384.359238ms iteration = 29 status = null
34322024-12-12T04:18:14.084ZDEBGnexus (BackgroundTasks): client request SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
34332024-12-12T04:18:14.084ZDEBGnexus (BackgroundTasks): client response SledAgent = 80af691a-30bb-4399-8524-a68071b516df background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf018cf8-2252-425d-a576-37dd721f5077", "content-length": "691", "date": "Thu, 12 Dec 2024 04:18:13 GMT"} })
34342024-12-12T04:18:14.084ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
34352024-12-12T04:18:14.084ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
34362024-12-12T04:18:14.084ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
34372024-12-12T04:18:14.085ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 425.374803ms iteration = 30 status = {}
34382024-12-12T04:18:14.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34392024-12-12T04:18:14.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34402024-12-12T04:18:14.119ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c4635247-5d4b-4f7c-ae5e-b1d4df6bd7b3, rack_id: 1612ec8d-a72c-445a-999f-274daa8c155e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(16ab99da-4da3-4a67-a57e-4d569b0ca16d) } rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0
34412024-12-12T04:18:14.119ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34422024-12-12T04:18:14.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34432024-12-12T04:18:14.129ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
34442024-12-12T04:18:14.129ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b6ec5e2-8cb1-4441-91bc-e4d6ce1a0dc5", "content-length": "134", "date": "Thu, 12 Dec 2024 04:18:13 GMT"} })
34452024-12-12T04:18:14.129ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
34462024-12-12T04:18:14.129ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 16ab99da-4da3-4a67-a57e-4d569b0ca16d
34472024-12-12T04:18:14.130ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
34482024-12-12T04:18:14.130ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
34492024-12-12T04:18:14.130ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34502024-12-12T04:18:14.130ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34512024-12-12T04:18:14.130ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34522024-12-12T04:18:14.130ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34532024-12-12T04:18:14.130ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34542024-12-12T04:18:14.130ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34552024-12-12T04:18:14.130ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e
34562024-12-12T04:18:14.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34572024-12-12T04:18:14.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34582024-12-12T04:18:14.133ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
34592024-12-12T04:18:14.133ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "015fe038-265e-48ba-b8a0-7f53fd09996c", "content-length": "2", "date": "Thu, 12 Dec 2024 04:18:13 GMT"} })
34602024-12-12T04:18:14.133ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
34612024-12-12T04:18:14.133ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cc0c9c6-4655-4f98-9a25-4700bb778c1c", "content-length": "52", "date": "Thu, 12 Dec 2024 04:18:13 GMT"} })
34622024-12-12T04:18:14.133ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch_location = Switch0
34632024-12-12T04:18:14.133ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
34642024-12-12T04:18:14.223ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "60764fad-eec7-487b-88d6-c9ef1e168ae7", "date": "Thu, 12 Dec 2024 04:18:13 GMT"} })
34652024-12-12T04:18:14.223ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e switch = Switch0
34662024-12-12T04:18:14.223ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
34672024-12-12T04:18:14.223ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1612ec8d-a72c-445a-999f-274daa8c155e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bdefa67-d3fc-4d35-a1db-91a1b7d15b06", "content-length": "682", "date": "Thu, 12 Dec 2024 04:18:13 GMT"} })
34682024-12-12T04:18:14.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34692024-12-12T04:18:14.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34702024-12-12T04:18:14.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34712024-12-12T04:18:14.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34722024-12-12T04:18:14.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34732024-12-12T04:18:14.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34742024-12-12T04:18:14.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34752024-12-12T04:18:14.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34762024-12-12T04:18:14.240ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 580.537199ms iteration = 29 status = {}
34772024-12-12T04:18:14.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 98fd6d50-eb5f-43c4-95f1-45a43dff266b roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34782024-12-12T04:18:14.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 98fd6d50-eb5f-43c4-95f1-45a43dff266b resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34792024-12-12T04:18:14.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 98fd6d50-eb5f-43c4-95f1-45a43dff266b response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34802024-12-12T04:18:15.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = cfc89026-4791-4b31-b70e-6671608fa26b roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34812024-12-12T04:18:15.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = cfc89026-4791-4b31-b70e-6671608fa26b resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34822024-12-12T04:18:15.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = cfc89026-4791-4b31-b70e-6671608fa26b response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34832024-12-12T04:18:16.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7834742a-dc0b-422c-8795-df74cc75c25f roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34842024-12-12T04:18:16.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7834742a-dc0b-422c-8795-df74cc75c25f resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34852024-12-12T04:18:16.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 7834742a-dc0b-422c-8795-df74cc75c25f response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34862024-12-12T04:18:17.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 67ba3c48-fd05-48a3-9202-267b9e2d316f roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34872024-12-12T04:18:17.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 67ba3c48-fd05-48a3-9202-267b9e2d316f resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34882024-12-12T04:18:17.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 67ba3c48-fd05-48a3-9202-267b9e2d316f response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34892024-12-12T04:18:18.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = f84f124e-04e0-43cf-9b9b-51d3d734758d roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34902024-12-12T04:18:18.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = f84f124e-04e0-43cf-9b9b-51d3d734758d resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34912024-12-12T04:18:18.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = f84f124e-04e0-43cf-9b9b-51d3d734758d response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34922024-12-12T04:18:19.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2e79868a-8e93-40fb-8162-50708274a58f roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34932024-12-12T04:18:19.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2e79868a-8e93-40fb-8162-50708274a58f resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34942024-12-12T04:18:19.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2602 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 2e79868a-8e93-40fb-8162-50708274a58f response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34952024-12-12T04:18:20.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dfe68aca-ff08-465d-84cf-21f84c7f739c roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34962024-12-12T04:18:20.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dfe68aca-ff08-465d-84cf-21f84c7f739c resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34972024-12-12T04:18:20.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = dfe68aca-ff08-465d-84cf-21f84c7f739c response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34982024-12-12T04:18:21.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = bda5628e-2f29-4c78-90df-bd47b9806638 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
34992024-12-12T04:18:21.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = bda5628e-2f29-4c78-90df-bd47b9806638 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
35002024-12-12T04:18:21.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = bda5628e-2f29-4c78-90df-bd47b9806638 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df
35012024-12-12T04:18:22.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 6b5ef235-2812-4367-940b-90a364448650 roles = RoleSet { roles: {} } uri = /probes/80af691a-30bb-4399-8524-a68071b516df
35022024-12-12T04:18:22.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 6b5ef235-2812-4367-940b-90a364448650 resource = Database result = Ok(()) uri = /probes/80af691a-30bb-4399-8524-a68071b516df
35032024-12-12T04:18:22.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1804 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64069 req_id = 6b5ef235-2812-4367-940b-90a364448650 response_code = 200 uri = /probes/80af691a-30bb-4399-8524-a68071b516df